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Ai)s  trac  t 


This  explores  the  statement  and  synthesis  o±  robot  plans  in 

dynamic  io^'ic.  Stanley  Kosenscliein  [Kosenschein  81]  has  developed  a 
formal  frariework  in  propositional  dynamic  lot^icj  I  extend  his  work 
to  u  first— order  lan^iuat^e*  The  approach  offers  a  ‘'possible  worlds" 
semantics  i o r  planSf  and  a  natural  treatment  of  disjunctive  and 
Quanti  fled  t^oais  and  hierarchical  plans*  Dynamic  lofeic  may  bridjje 
the  fcjap  between  earlier  lorraal  treatents  of  planning  in  the 
situational  calculust  and  the  more  popular  and  efficient  state— space 


planning  systems  such  as  STRIPS* 
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Cl^APVilR  1 
IN'J  ION 


Chif.  thoHis  explortjs  a  new  iornmla+ion  ol  the  robot  i-lanniiit_: 
;jrt»blen  in  terms  of  ciyrianjic  lofcjic  ( DL  )  .  The  ^.eneral  loriii  of  a 
pJunnln^,.  pioblefa  is  to  find  a  sequence  of  actions  »»’i>ich  will 


t  r  an  s  f  or  r. 


set  of  ini  tial  world 


into  a  set  of  ^^oal 


where  a  set  of  states  is  usually  described  by  a  logical  forniula# 
Farly  researchers  reduced  ».<lanninfe;  to  theorem  j^rovin^  in  a 
f  i  rs-;  t  -  or<- e  r  ianfc;ua4;e  called  the  situational  calculus  [McCarthj-  and 
Hayes  bi  ].  Tiiis  approach  offers  a  well-defined  semantics  for  plans 


(  nai.-.c  1  >  f  any  "standard"  semantics  ol  first-order  lo^^ic)* 


rich 


vocohulaiy  for 


world  states,  and  a  provably  correct  and 


complete  |  Itinninti  process.  But  tbe  situational  calculus  has  nothing 
to  say  abt,ut  how  tne  search  lor  plans  is  structured;  without  such 


control  k  wl  edi- e  ,  a  planner  is  hopelessly  inefficient. 


The  bllllPS  series  of  planners  [Pikes  and  Nilsson  71] 

cc>ncentratt‘d  on  such  efficiency  issues,  but  ne^ilected  many  of  the 
positive  features  of  the  "p>ureJy  lopiical"  approach.  World 

descr  i  pt  i  <»ns  wei'e  limited  to  conjunctions  of  literals,  making 
disjunctive  and  Quantified  knowledge  inexpressible;  actions  were 

defined  l>y  simple  syntactic  operators  ("add  lists"  and  "delete 


lists")  which  lacked  clear  semantics* 


INTRODUCT I OR 

Stonltii  Rosenachein  has 
dynamic  a  modal  1 

[Harei  79]  [Prairt  76J|  an 
alfe'orithm  ("bidirectional 
synthesi  ?1  rifei  a  broad  class  o 
situational  calculusy  ac t i 
leading  to  provably  correct 
algorithm  structures  the 
ele^^antly  handles  conditiona 


xornulated  plannl 


o^ic  developed  lor 


d  has  ^’iven  a  c 


progression  and 


f  plans  (Rosenschei 


ons  are  described 


plans;  as  in 


search.  The  frain 


1  actions  and  hiera 


Pa^^  e  2 

n^  in  propositional 
program  verification 
oiaplete  "bi4,reS3ioj:i" 
retiressi  on"  )  for 
n  81].  As  in  the 
by  lo;Jical  ax  i oins  t 
STRIPS,  an  explicit 
ework  naturally  and 
rchical  plans. 


I  will  define  a  first— order  dynamic  lo^ic  suitable  for  stating 
planning  problems,  and  extenci  Rosenschein*  s  algorithm  to  handle  a 
subset  ol  the  language.  Much  of  the  work  centers  on  calculating  the 
effect  oJ  a  possibly  no  n— de  tercii  n  i  st  ic  action  upon  our  knowledge  of 
the  world  when  the  simplifying  STRIPS  assumptions  are  abandoned. 

Many  problems  which  are  difficult  to  even  state  using 
STRIPS— like  operators  can  be  readily  solved  by  a  DL— planner.  The 
familiar  blocks— world  repertoire  is  immediately  expanded  to  include 
d^sJ^uncjt  iye  ea^a  Is ,  as  in  the  command,  "Build  a  red  tower  OR  a  blue 
tower."  L’^^dced  injormajt  i^on  is  no  longer  problematical.  Given 
axioms  to  describe  the  predicate  NEXTTO  in  terms  of  ON,  no  special 
rules  are  needed  to  "delete"  NEXTTO(BLKl,  BLK2)  from  the  world 
description  when  CN(i3LKl,  BOX3)  or  ON(BLK2,  BOX3)  becomes  false. 
Bound  variables  may  appear  in  goal  or  action  descriptions,  as  in 
"Put  SOME  red  block  in  the  box,  and  keep  ALL  the  others  in  place", 
or  "The  action  IRRADIATE(x)  sterilizes  ALL  the  fruit-flies  in  dish 


X  . 


TNTRODUCT ION 


Pa^^e  3 


Consider  the  "3-socks'*  problem*  You  stand  in  a  lightless  room 
belore  a  dresser  full  of  loose  socksy  some  black  and  some  white* 
How  many  socks  must  you  pull  from  the  dresser  before  you  can  be  sure 
that  you  have  a  matching  pair?  Not  only  is  the  goal  inoefinite  — 
get  two  black  socks  OK  two  white  sockSf  and  I  don't  care  which  socks 
in  particular  —  but  the  "pull  out  a  sock"  action  is 
non— det er mi n is t i c *  Yet  the  problem  is  solvable  because  its 
non-de  teriai  n  isra  is  constrained  in  a  known  way  I  the  sock  will  be 
distinct  frora  those  obtained  earlier  and  will  be  either  black  or 
whi te • 

DL— action  axioms  can  encode  more  information  about  "pull  out  a 
sock"  than  can  any  simple  add— 1 i st /delet e— 11 s t  pair*  It  is 
unlikely*  of  course*  t^^a  t  any  finite  representation  will  succeed  in 
capturing  conceivably  relevant  effects  of  a  real-world  action* 
It  is  important*  therefore*  that  the  representation  be  monotonically 
extensible*  Every  DL— axiom  specifies  some  partial  effects  of  an 
action;  unless  the  system  is  made  inconsistent*  adding  more  axioms 
will  never  invalidate  an  old  plan*  The  opposite  is  generally  true 
of  strips;  one  is  forced  to  to  add  new  actions  rather  than 
redefining  old  ones  if  compatibility  is  to  be  retained* 

The  price  the  DL  approach  pays  for  its  flexibility  is  the  need 
for  "frame  axioms"*  axioms  which  specify  ail  the  predicates  which  a 
action  does  NOT  affect*  But  frame  actions  are  useful  for  describing 
actions  with  possible  side— effects* 

This  thesis  shall  not  concentrate  on  particular  heuristics  for 
choosing  "good"  actions  when  building  a  plan*  Instead*  two  classic 


I  NTKODUCTION 


Pat'e  4 


A*I*  teclini.|ues  for  reduciriti  the  size  of  the  search  space  shall  he 
applied  to  the  DL  framework*  Tic  first  involves  nier^i  nfe  branches  of 
the  search  tree  by  allowinti  i  ncoiapletely- spec  if  led  actions  in 
partial  plans  [Suss nan  75]* 


Perhaps  the  ^ireatest  efficiencies  can  be  obtained  throut^h  the 
use  of  plan  hierarchies*  This  is  comnionly  iinpleinent  ed  ( ef? »  AUSTklPS 
[Sacerdotl  74]  and  NOAH  [Sacerdoti  77])  by  t eraporari ly  hiding,  "less 
important"  details  from  the  plannin^^  unit;  when  the  details  are 
filled  irif  the  plan  may  be  in  error  and  must  be  patched  up*  The 
complexity  of  the  patching  process,  unfortunately,  weakens  our  faith 
in  the  ultimate  correctness  of  the  plan  ad  the  overall  efficiency  of 
the  strategy*  The  DL  framework,  on  the  other  hand,  suggests  an 
exact  hierarciiy*  The  basic  actions  on  one  level  are  simply  planning 
problems  to  be  solved  on  lower  levels*  A  subplan  is  guaranteed  not 
to  unexpectedly  clash  with  other  parts  of  the  high-level  plan* 

1*11  consider  "good"  decompositions  of  the  blocks  and 
"dungeons"  worlds*  One  can  specify  how  "general"  a  subplan  stiould 
be,  balancing  the  i^ossibly  higher  cost  of  finding  a  very  general 
plan  against  its  greater  potential  for  reuse* 


Finally,  1*11  discuss  some  further  extensions  of  the  language 
and  the  algorithm*  The  system  has  not  been  implemented*  The 
immediate  concern  is  to  demonstrate  that  the  method  is  sound,  and 
potentially  better  lhan  anything  currently  available* 


CHAPTEK  2 


INTELLECTUAL  ORIGINS 


In  Its  broadest  sense*  "plannin45*'  incorporates  wbat  mi^ht  be 

taken  as  the  task  oi  artlticai  i n t ell i gence : 

•  •we  want  a  computer  program  that  decides  what  to  cio 
by  inferring  in  a  formal  language  that  a  certain 
strategy  will  aclileve  its  assigned  goal  •  [McCarthy 
a  nd  riaye  s  6  9] 

An  intelligent  prograia  must  possess  an  adequate  repr eseiita tlon  of 
the  world*  including  its  own  desires  and  abilities*  and  a  mechanism 
for  applylpfei  its  knowledge  to  solve  the  problems  at  hand* 

Much  work  has  been  done  on  robot  planning  systems^  In  the 
classic  scenario*  the  system  guides  a  robot  in  manipulating  objects 
In  a  very  simple  model  of  the  physical  world*  The  problem  presented 
to  the  system  is  to  devise  a  sequence  of  actions*  a  jy^an  *  which  will 
transform  a  given  initial  state  into  a  goal  state*  The  robot  is  the 
only  active  entity;  its  knowledge  of  the  world  is  simply  identified 
with  the  representation  chosen  lor  states  and  actions* 

In  recent  years*  exciting  research  has  proceeded  toward  a  more 
psychologically  sophisticated  theory  of  planning;  for  example*  see 


[Cohen  78]  [Moore  80]  [Haas  81]* 


Prolegomena  to  the  specification 


I  NTLLLiC'I  UAl  ORIGINS 
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ol  any  v'i  systeai,  tiowever*  are  the  questlonsi 

—  Whut  formally  is  a  plan  f  a  planning  probleia»  and  a  solution? 

— How  is  the  search  for  solutions  organized?  Is  the  strategy 
provably  correct? 

—  For  what  class  of  probletis  is  It  complete? 

Rosenschein • s  work  provides  an  elegant  set  of  answers  which 
urilfy'  and  clarify  the  approaches  adopted  by  a  number  of  earlier 
methodologies*  This  chapter  briefly  describes  some  of  these 
influences  and  summarises  (with  very  minor  adJustmentSf  to  lead  more 
smoothly  Into  the  extensions  of  chapter  3)  the  framework  presented 
in  [Rosenschein  81]* 

2.1  SITUATIONAL  CALCULUS 

A  situation  s  is  the  complete  state  of  the  universe  at  an 
Instant  of  time*  A  first-order  logic  which  allows  situations  to  be 
the  values  of  terms  is  a  situational  calculus*  [McCarthy  and  Hayes 
69]  provides  a  discussion  of  the  philosophical  underpinnings  of  the 
use  of  situations  to  describe  action»  causality*  and  ability* 
[Green  6La]  reduced  robot  planning  to  theorem  proving  in  a  version 
of  the  situational  calculus* 

Each  predicate  takes  an  argument  specifying  a  situation*  For 
example*  "on ( a * B > Si  )  ”  asserts  that  (the  entity  denoted  by)  A  is  on  B 
in  situation  SI*  Some  functions  evaluate  to  actions*  "Mo ve ( A * B * C ) " 


is  a  term  which  stands  for  the 


action  of  moving  object  A  from 
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location  iJ  onto  C« 

The  function  " resu 1 t ( a , s ) ”  maps  a  state  s  and  an  action  a  to 
the  state  resuitinti  from  performint;  the  action  in  s* 

A  piannintji  problem  is  formulated  as  follows*  The  initial  state 
is  described  by  a  wff  all  of  whose  predicates  include  some  arbitrary 
situation  SO*  The  desired  final  state  is  described  by  a  wff  whose 
common  situational  variable  is  existentially  quantified*  The 
problem  is  to  find  a  constructive  proof  that  the  second  wff  follows 
from  the  first  —  for  exampley  that 
on(AyBtSO)  Es  on(A,Cfs) 

—  us  injj  a  set  of  a  x  ioms  which  spec  ify  the  results  of  the  ac  t  ions  * 

An  axiom  for  move  mi^ht  be 

Vsxyz  ((onlxfyfs)  a  location(z))  ^ 

on(xyZf  result ( move ( X, y, z ) ,  s))) 

A  constructive  proof  the  problem  wff  actually  finds  the  situation  s 
sucli  that  on(AfCys)*  In  this  casey 

on(AyBySO)  =>  on{AyCy  resul  t  (  move  (  A  y  By  C)  y  SO  )  ) 

Thusy  the  i»lan  to  achieve  on(AyC)  given  on(AyB)  is  to  perform 
m  o V  e(AyByC)  * 

PraiseM'orthy  features  of  this  approach  include! 

X  solution  to  a  solvable  problem  can  be  guaranteed  to  be  found 
if  a  complete  first-order  proof  strategy  (such  as  resolution  with 
answer— ex  tract ion  [Green  69b]  )  is  employed* 

Correctness  of  plans  is  obviousy  from  correctness  of  the 


underlying  proof  procedure* 
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A  well  understood  semantics  ejtists  (namelyt  typical 

semantics  for  first-order  logic)  for  plans  and  planning  problems* 

There  Is  extreme  flexibility  in  stating  axioms  and  i fanning 
problems;  there  are  no  inherent  objections  to  including 

quantifiers*  disjunctions*  additional  functions*  etc* 

Yet  the  situational  calculus  says  nothing  about  how  the  search 
lor  solutions  is  •  Without  adequate  control  knowledge* 

any  theorem  prover  will  be  excessively  slow* 

Axioms  must  specify  what  each  action  does  no_t  change*  In  order 
to  derive 

(ori(A*U*SO)  A  location(C)  a  on(D*E*SO))  3 
(on(A*C*  resul t ( move ( A  * B * C ) *  SO )  )  a 
on(D*E*  resul t ( move ( A  * B * C ) *  SO )  )  ) 

an  axiom  is  required  to  the  effect  that  an  object  not  being  moved 

stays  in  the  same  place! 

Vsvwxj  z  ((on(v*w*s)  a  w^x) 

on(v*w*  r esult ( move ( X * y * z ) * s ) ) ) 

The  computational  problem  of  dealing  with  a  large  number  of  such 
axioms  is  called  the  frame  problem* 

Finally*  the  notation  is  rather  awkward*  One  may  also  feel 
that  the  treatment  of  situations*  actions*  and  objects  —  all  merely 
elements  of  the  domain  of  interpretation  —  is  overly  homogeneous* 
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2.2  ^TAl f  SPACE  MODELS 

! 

A  tenlly  of  situations  can  be  ruocteled  by  a  lo£;ical  formuia,  its 
sta;te  E.g.»  on(A,B)  reijresents  all  situations  where 

(the  entity  denoted  by)  A  rests  on  B.  Planning  can  be  performed  by 
searching  the  space  of  state  descrip ti ons »  for  a  path  from  the 
initial  state  description  to  one  which  entails  the  ^cal  description. 
Actions  are  modeled  by  opera^tors  which  change  one  state  description 
into  another. 

The  STRIPS  series  of  planners  [Pikes  and  Nilsson  71]  avoided 
the  frame  problem  l>y  limiting  state  descriptions  to  sets 
(conjunctions)  of  literals*  and  re  pre  sen  t  i  n^j  actions  by  syntactic 
operators  which  transformed  descriptions  by  explicitly  adding  and 
deleting  Ijr  oposi  1 1  o  ns .  For  instance*  the  move  operator  can  be 
written 

move  (  X  *  y  *  2: ) 

precondition  list:  on(x*y) 

add  list:  on  (3' *2:) 

delete  list:  on(x*y) 

The  instantiation  move(A*B*C)  of  move  can  only  be  applied  to  state 
descriptions  containing,  on(A*B)  *  and  its  effect  is  to  I'eplace  that 
proposltiori  with  on(}J*C). 

STRIPS  decouples  search  from  theorem  proving.  Theorem  proving 
is  employed  within  a  state  description  to  discover  what  operators 
are  applicable*  and  what  ^oals  have  been  achieved.  Search  is 
directed  by  a  means-end  analysis  algorithm  [Newell  and  Simon  63]. 
An  operator  is  chosen  whose  effects  (add  list)  reduce  the  difference 
between  the  goal  and  the  current  state  description.  If  the  operator 
is  applicable  to  the  current  state*  it  is  immediately  applied; 
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otherwise,  its  precondition  becomes  a  new  ^^oai  to  be  achieved#  This 
" bac kwar d-c  tmi ni ng"  search  is  foa 1— o ri en ted ,  but  state  descriptions 
are  always  developed  in  a  forward  direction* 

STRIPS*  handlinti  of  conjunctive  and  disjunctive  e;oals  is  fairly 
weak*  It  tries  to  achieve  each  literal  in  a  conjunctive  e^oal  in  a 
linear  order;  if  an  air  eady~achieved  goal  is  undone,  planniiig  is 
reattempted  with  the  literals  in  a  different  order*  STkIPS  always 
attempt  to  achieve  one  disjunct  of  a  disjunctive  goal* 

STRIPS  made  great  strides  in  efficiency*  But  tlie  non— logical 
nature  of  its  operators  make  it  difficult  to  formally  prove  the 
correctness  or  completeness  of  the  system;  indeed,  its  strategy  is 
demonstrably  not  complete*  The  frame  conditions  for  actions  with 
possible  side  effects,  so-called  infljH  ostial  operators  [Waldinger 
77],  can  be  too  complex  to  be  represented  by  the  STRIPS  default 
rule*  Nor  Is  it  always  reasonable  to  assume  that  the  machine *s 
knowledge  of  the  world  can  always  be  represented  by  a  conjunction  of 
1 i te  rai s  * 

A  protilem  solver  can  also  search  by  transforming  the  goal 
description,  in  stages,  to  the  initial  state  description,  by 
applying  the  inverses  of  the  action  operators*  Passing  a 
relationship  back  through  an  operator  is  called  re^^ression  *  An 
uninformed  forward  or  backward  breadth-first  search  can  be  the  basis 
for  a  complete  planning  strategy  [Nilsson  80]* 

The  RS'J'RIPS  systera  [Waldinger  77]  improved  STRIPS*  handling  of 
conllictiiife  conjunctive  goals*  When  an  attempt  to  achieve  a 
particular  goal  literal  interferes  with  an  already  achieved  goal. 
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the  of  lending  ^oal  .literal  is  regressed  back  through  the 
parti  ally— c  ons  true  t  ed  plant  in  the  hope  tlial  i  I  will  be  easier  to 
achieve  at  an  eariiei-  point  in  the  plan*  Its  coverage  a  f  the 
solution  sijacet  howevert  is  still  incomplete  and  not  completely 
characteriz,ed* 

Tl»e  REFLECT  planner  [Dawson  and  Siklossy  77]  did  perlorm  pure 
backward  searcht  regressing  en  tire  goal  desc ri p t i ons *  without 
focusing  on  achieving  particular  goal  literals*  Simple  STRIPS 
operators  and  pruning  heuristics  (similar  in  spirit  to  those  that 
appear  in  Rosensche in * s  algorithm)  allow  REFLECT  to  solve  problems 
requiring  fairly  long  solutions* 


2*3  HIERARCHICAL  PLANNING 

The  Space  searched  by  a  general  planning  system  tends  to  grow 
exponentially  as  the  distance  between  the  initial  and  goal  states 
increases*  Various  approaches  reduce  search  by  asserting  a 
"vertical”  control  structure* 

The  creators  of  STRIPS  experimented  with  using  generalized 
versions  of  previously  solved  plans  as  "macro  operators" »  or  MACROPS 
[FlkeSf  Hart,  and  Nilsson  72]*  A  MACKOP  provides  a  short-cut 

through  tlic  search  space - if  the  system  is  so  fortunate  as  to  have 

previously  solved  a  problem  which  is  a  current  subtask*  REFLECT 
systematically  combined  primitive  operators  into  BIGOPS  during  a 
preprocessing  stage*  For  example,  an  operator  to  pick  up  a  block, 
and  an  operator  to  stack  a  block  being  held  on  top  of  another,  are 
paired  in  the  BIGOP  "pickupAstack" *  If  the  planner  only  uses  paired 
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EIGOPS,  the  search  space  is  cut  in  half*  NACFOFb  and  blGOP5j  f.re 
slniply  expanded  at  plan  execution  time# 

NtACKOf’S  and  BIGCPS  preserve  all  the  preconditions  ana  effects 
of  their  coiaponent  operators*  [Sacerdoti  74]  argues  that  the 
retention  of  detail  ^^reatly  liraits  the  heuristic  value  of  such 
simplifying;  representations*  A  hjL®rarchy  of  abstraction  spaces 
should  model  the  world  and  actions  in  less  and  less  detail  •  A 
short »  abstract  plan  can  be  quickly  found  at  the  least  detailed 
level*  Subtasks  are  created  at  the  next  level  of  detail  to  link  the 
steps  of  ttxe  abstract  plan*  Only  at  the  bottom  of  the  hierarchy  are 
all  the  facts  known  to  tlie  planner  considered!  but  t  lie  search 
remains  elficient»  as  it  is  ti4'.htly  constrained  by  the  more  abstract 
pi  an  * 

ABSTKIPS  [Sacerdoti  74]  and  NOAH  [Sacerdoti  77]  implemented  a 
small  portion  of  this  philosophy  by  selectively  i^nor infc  action 
preconditions*  In  AJBSTKIPSf  preconditions  were  assigned  criticality 
values*  At  abstraction  level  Nf  the  operators  are  simplified  by 
disre45ardiri  fei  preconditions  valued  less  than  N*  The  planner 
repeatedly  patches  the  abstract  plant  so  that  it  remains  correct  foi- 
the  more  and  more  detailed  versions  of  the  operators* 

NOAH  represents  actions  by  ££ocedureSt  and  permits  a  dynamic 
hierarchyt  but  the  approach  is  basically  the  the  same!  some 
preconditions  are  initially  iijnoredt  and  the  initial  plan  is 
heurlsticaJ ly  patched  up* 

A  *'detail"t  howevert  is  not  necessarily  an  unimportant  detail* 
The  patchin,^  process  can  simply  fall  at  any  level*  The  planner 
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could  try  1o  come  up  with  another  abstract  plan  —  but  would  have  no 
guarantee  that  this  second  attempt  would  not  be  unfijtable  as  well* 

At^aiOf  no  lormal  description  of  the  planning  systems  or  tiie 
precise  relationship  between  the  levels  of  the  hierarcliy  was  ever 
presen  ted • 


2.4  PLANNING  IN  PRCPOS I T lONAL  DYNAMIC  LOGIC 


Dynamic  lo^^  ic  is  a  tool  for  reasoning  about  binary 
s tat e- re 1 a t i onsh i ps  induced  b>  computer  programs y  developed  by 
workers  in  pro^jram  semantics  and  verification  [Haiei  79]  [Praft  76]. 
[ Rosenschein  81]  formulated  planning  in  terms  of  propositional 
dynamic  logic*  explicitly  equating  the  notions  of  "plan"  and 
"program"*  Plans  are  allowed  to  contain  tests  and  conditional 
sequences  <.>  f  actions* 


A  dynamic  logic  is  a  modal  logic  I  a  plan 
relationship  over  a  set  of  possible  worlds, 
corresponds  to  a  "necessary"  modality;  [Ajp  is  t 
p  is  true  in  every  world  reachable  from  I  by 

read*  "after  A,  p".  Similarly*  <A>  corresponds 
modality;  <A>p  is  true  in  a  world  I  if  p  is 
reachable  iroia  I  by  A.  The  fact  that  the  box  and 
are  distinct  intuitively  implies  that 

n  on~de  t  e  r  n»  i  n  i  s  t  i  c  .  When  p  ^[A]q  holds*  we  say  "p 

hut  perhaps  not  necessary)  precondition  of  A 


is  a  reachability 
If  A  is  a  plan*  [A] 
rue  in  a  world  I  if 
A.  So  [A]p  can  be 
to  a  "possible" 
true  in  some  world 
diamond  modalities 
plans  may  be 
is  a  (sufficient* 
and  q"  and  "q  is  a 


postcondition  of  p  and  A*' 
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A  looi>-free  subafet  ol  propositional  dynamic  lofeic  is  del'ined  as 
follows: 


2  •4.  1  Syntax 


A  dialect  of  PEL  is  specified  by  its  atomic  propositions  PROP 

and  atomic  actions  ACT#  Define  Wffs  and  Plans  over  <PROP,ACT> 

Inductively  by: 

!•  If  i'  e  P siOP  then  p  e  Wffs 

2«  If  a  e  ACTS  then  a  e  Plans 

3.  If  ptq  e  Wffs  then  -ip,  p  v  q  e  Wffs 

4#  If  p  e  Wffs  and  A  e  Plans  then  <A>p  e  Wffs 

5#  null  €  Plans 

6#  If  p  €  Wffs  and  nonmodalt  and  A»B  e  Plans*  then 

A;B  *  a  U  B*  and  p?  e  Plans 


A  wff  is  noninodal  if  it  contains  no  subformula  of  the  form 
<A>p*  Abbreviate: 


-H  (  -*p  V  -tq  ) 

as 

p  A 

-ip  V  q 

as 

p  =» 

as 

£  A] 

(p?;a  u  -*p?;b) 

as 

(P 

The  forr.i  (p  -*A  *  B )  represents  the  conditional,  IF  p  THEN  A  ELSE  B. 
The  form  A;B  represents  the  sequential  execution  of  A  then  B«  We 
write  A;B;c;  indifferently  for  (A;B);C  or  A;(B;C)« 


2#4*2  Semantics 

The  semantics  described  here  are  a  subset  of  the  first— order 
semantics  presented  in  ttie  next  chapter,  rather  than  those  which 
appear  in  [Rosenscheln  81 ]•  A  structure  for  PDL  contains  a  set  of 
worlds  WD  and  a  function  ra  which  interprets  each  atomic  action  as  a 


binary  relationship  over  WD  (i«e«,  a  set  of  pairs  of  worlds)* 


Each 
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world  aBsip^ns  a  truth  value  to  the  atomic  propositions!  if  p  liolds 
in  world  1»  write  lj=p«  Mutually  define  truth  for  non— atomic  wffs 
in  a  world  I,  and  a  meaning  function  M  for  general  plans: 

Truth  of  formulas 

ll=  -ip  iff  not  I  1  =p 

li=  P  V  q  iff  l|  =  p  or  I  I =q 

l|=  <B>p  iff  exists  J  €  WD  such  that 

(IfJ)  €  M(B)  and  J | =p 


Meanings  of  Programs 

M(a)  =  ra(a)  for  a  e  ACT 
M(null)  =  CClfl)  1  I  €  ^D} 

(identity  relation  over  WD) 

M(p?)  =  {(1,1)  1  I  I =  p) 

(identity  relation  restricted  to  worlds 
where  p  holds) 

M(A;B)  =  m(A)  o  m(B) 

(composition  of  relations) 

M(  A  U  B)  =  m{  A)  u  m(  B) 

(vinion  of  relations  considered  as  sets) 

A  structure  satisfies  a  wff  if  the  wff  is  true  in  every  world  In  the 

structure*  A  valj.d  wff  is  satisfied  by  all  structures* 


2*4*3  Axiomatlcs 


Take  A  and  B  to  be  any  Plans,  p  and  q  to  be  any  Wffs*  A 
complete  axi  oinat  iza  t  ion  of  uninterpreted  loop  — free  PDL  is  given  by: 
Axioms 


1*  Axioms  of  propositional  calculus 
2*  {A](p  3  q)  3  ([A]p  3  £A]q) 

3*  [ null ]p  =  p 

4.  [p?]q  =  (p  =>  q) 

5.  [A;B]p  5  [A][B]p 

6*  [A  U  B]p  =  ([A]iJ  A  [Bjp) 
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K'ules  ol  fnl'erence 

FroiTi  pf  p^q  derive  q 
From  p  lerive  [A]p 


Write  Hp  if  p  is  i;rovable  froir.  these  axioms «  and  GJ-p  if  p  is 
provable  fro^a  tne  axioms  augmented  by  some  set  of  wffs  G» 


2 *4 >4  Normal  Form  flans 


A  plan  in  which  the  (test)  and  "U”  ( non— deternii  ni  s  ti  c 


choice ) 

operators  are 

only  used 

to  construct 

c  o  ndi 

t i onal 

forms 

(  p  -  A* 

B) 

is  a  C-Plan*  A 

plan  B  is 

in  normal  form 

if: 

(1 

) 

n  can  be  written 

as  ai;a2;. 

most 

one  Ai 

not 

atom ic i  and 


(  i i )  Such  a 

n  Ai 

is  of  the  fo  r  m 

(t  - 

Bl *B2) * 

where 

t 

1  s 

an 

atomic  prop 

osl  t 

ion*  and  Bl  and 

B2  are 

in  normal  form* 

Any  C-Plan  is  eq 

a  i  va 

lent  to  a  C-Plan 

i  n 

normal 

form  * 

A 

se  t 

of 

mean! ng-preser vi 

ng 

trans  forma  ti ons 

that 

can  be 

used 

to 

pu  t 

any 

C  — Plan  in  normal  form  is  easily  found;  for  exaniple» 
(-•p  -*  A 1 1* )  becomes  (p  -*  B,A) 

(p  V  q  —  A,B)  becomes  (p  —  A,(q  -*  AtB)) 


(p  -*  BlyB 2 );•••;  (q  -♦  B3tB4)  becomes 
P  -  (Bl;...;(q  -  B3,B4)),  (B2; 


; (q  -B3,B4) ) 


We*  11  only^  look  for  normal  form  plans  as  solutions  to  planning 
problems*  The  following  discussion  is  simplified  by  informally 
Identifying,  the  null  action  with  a  plan  of  length  0*  and  taking 
A;null  =  null; A  =  A  for  any  plan  A*  (It  is  obvious*  ol  course*  that 
the  J^nterpre tation  ol  the  three  strings  above  is  identical*) 
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2«4«5  A  Plannitig  Problem 


If 


r  describes  some  inltiaL  sfafet  and  s  describes  some  ^oaLy 


the  wff 


V  3  [  A  J  s 

clearly  asserts  that  A  is  a  plan  for 
Slrailarlyy  if  a  is  an  atomic  actiony  one  may 
p  =>  [  a  ]  q 


ac  h  iev  i  nt^ 
wri  te 


given 


r  • 


to  assert  that  p  is  a 
Lose n sc he  in  defines  a 
where 

1.  VOC  =  <PROPyACT>  is 

2*  G  is  a  finite  set 
c  ont  a i ns  : 


precondition  for  using  a  to  achieve  q« 
planning  LiTobJLem  as  a  triple  <  VOC  y  G  y  RES  (  u )  > 


the  vocabulary  of 
of  axiomSy  the 


fhe  problem, 
domain  c  onst  ra i n  t s • 


I  t 


Gsy  a  set 

of 

n  o  nmoda 

Gdy  a  set 

of 

dynamic 

1  n  pa  r  t ) 

the 

e  f  fee  ts 

is  o  1  1  l\e 

f  o 

rm  p  a 

atom i c . 

iy  or  sjtajti.c  constraints. 

constraintsy  which  specify  (perhaps 
of  the  atonic  actions.  Each  dynamic 
]  qy  wiiere  p  and  q  are  nonmodal  and 


only 
axiom 
a  is 


3.  PES(u)  is  a  finite  set  of  formulae  called  tlie  £lan  constrain  ts . 
Eaci.  is  of  tiie  form  r  =>Cu]  s  where  r  and  s  are  nonmodal.  "u"  is  a 
special  syntactic  variable  which  does  not  appear  in  VOC. 


A  so  1 ut ion  to  such  a  planning  problem  is  normal  —  forra  plan  B  (in 
the  dialect  VOC)  such  that  substituting  B  for  u  in  each  of  the  plan 
constraints  creates  a  formula  derivable  from  the  domain  constraints. 
That  is  y  GH  r  =>£  B  ]  s  for  eacl»  formula  r  ^[u]  s  in  RES.  Solutions 
can  also  be  ebar  ac  t  e  r  1 2:ed  semant  lea  lly  I  structures  that  satisfy  the 
domain  constraints  also  satisfy  the  B-instan t la t ed  plan  constraints. 


I  NTI'LLLCTnAL  ORIUINis 


Fat^e  lii 


2.4«6  A  l^larinin^  Altiorithm 


Rosenschein  suggests 

that 

the  search  for 

solu  ti  ons 

to 

a 

planning  problem  be 

orga 

nl  zed 

by  the  syntactic 

s t  rue  t  ure 

of 

the 

(planning  (programming) 

language. 

Suppose  we  are 

1 ooki ng 

for 

a 

normal  forr-  plan  A 

that 

satisfies  one  of  the 

plan  constral 

n  ts 

r  3[A]s  in  KHS«  Consider  the  tollowin^  cases  corresponding  to  the 

possible  lorms  of  A  I 

1  •  A  =  null.  Tills  is  a  solution  if  GH  r^s. 

2.  A  =  a;B  or  A  =  B;a  for  sonie  atomic  action  a.  In  the  former 

caset  A  is  a  solution  if  GK  r/a  [  B  ]  s  t  where  r/a  represents  the 

s_tro|i^es_t  provable  postcondition  of  r  and  a*  Analogously*  in  the 
second  case*  A  is  a  solution  if  Gl-  r  3[B]a\s  where  a\s  is  the 
weakes_t  provable  precondition  of  a  and  s«  We  call  the  former  case 
"progression'’  and  the  latter  " re^sressl  on"  • 

3.  A  =  t  -•  EltB2«  In  tills  case*  A  is  a  solution  if 

GH  (r  A  t):3[ill]s  and  GH-  (r  a  -it)r>£B2]s* 


Case  (1)  defines  success,  (2)  sut^gests  forward  and  backward 
stratetjles  for  sequential  steps,  and  (3)  suggests  a  forward  strategy 
lor  conditionals. 


There  are  a  number  of  simple  ways  of  pruning  the  search  tree. 
First,  if  r3r/a,  tlie  forward  search  need  not  consider  action  a. 
(Intuitively,  a  would  not  achieve  anything  that  does  not  already 
hold  in  r.)  Dually,  if  aVs^s,  the  backward  search  need  not  consider 
a.  ( a\s  describes  a  goal  which  is  harder  to  achieve  than  s  — 
perhaps  impossible,  when  a\s  is  false.)  These  check  eliminate 
self-loops;  as  described  in  chapter  4,  they  can  be  extended  to 
eliminate  ail  loops  in  the  search  space.  Finally,  if  r^  t  or  r=)-«t, 
it  Is  not  necessary  to  pursue  the  forward  conditional  search 
involving  t:  the  test  uncovers  no  new  information. 
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I'heKe  »>bser  va  t  io!i3  lead  to 
bidirectional  nearch  algorithm.* 
solved  J'or  by  calling  UlGRESS(r,s) 

B  IGK'ESSION 


the  following  nonde term! ni s t ic » 
The  single  constraint  r^[u]s  is 


ALGORITHM 


hIGKESS(r,  s): 


If  Gl-  r=*s  then  return!  null  )  • 
Choose  I 


Choose  <af 
re  t urn ( 


r/a>  from  Li  veE'orward  (  r  )  ; 
a  ;  BlGKESiS  (  r/a»  s  )  )• 


Choose  <af 
I'e  t  ur  n  ( 


a\s>  from  L i veBac k wa rd ( s ) ; 
BIGKE3S (  r,  a\s  ) ;a  ) . 


end* 


Choose  t  fi'oia  NonTriv(r)  ; 

reitura!  t  BIGKESS(  r  a  t,  s 

dlGKESS!  r  A  -,t, 


)  . 

s  ) 


)  . 


Li veForward ( r ) I 

return  (  <a,  r/a>  1  a  e  ACT,  r^r/a). 


L iveBackw ar d ( s ) : 

return  (  <a,  a\s>  |  a  e  ACT,  G|^  a\s3s)  • 

N onT  ri  V  (  r  )  : 

return  {  t  |  t  e  PROP,  G»/  p^t,  G\/-  pr)-it} 

planning 
in  which 
one  of 
hoice  is 
multiple 


1  he  algorithm  still  presents  a  fairly  abstract  view  o±  the 
process;  it  says  notliing  about  the  particular  order 
"choices"  are  made,  when  backtracking  is  invoked,  etc*  (1± 
the  subprocedures  returns  an  empty  set  at  some  point,  that  c 


obviously  prohibited*)  The  extensions  to  BIGRESS  to  handle 


*  Rosen  sc  hoi n  *  s 
two  additional 
each  recursive 
the  entile  plan 


original  statement 
parameters  to  jiass 
instance  of  BIGRESS 


of 

the 


the  algorithm  differed 
partially  constructed 
The  innermost  instance 


by  using 
plan  to 
re  turned 
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f  ons  t  ra  i  n  ts 
chapter  4. 
p  rt)t.  re  ss  i  on 
i  mpl  etnen  t  eti  • 


aro  discussed  alont  with  the  lirst— order  extensions 
vVe  now  discuss  how  the  provability  test,  and 

and  rei^ression  functions,  »»/••  and  can 


i  n 
tiie 
be 


2«4«7  Provability,  Pro^i  re  ss  i  on  ,  And  Regression 


It  is  liotoriously  difficult  to  mechanize  modal  proof  systems; 
the  auxiliary  functions  are  implemented  using  only  ordinary 
proposi  t  i  Olio  I  decision  methods*  The  key  requirement  is  that  the 
Monmodal  axioms,  Gs,  be  strong  enough  to  generate  all  nonmodal 
1  oriaulae  generated  by  all  of  G»  Rosenschein  does  not  present  a 
proof  that  this  condition  can  always  be  enforced,  while  Gs  remains 


finite*  ,'!.ec  tioM  4*3  discusses  some  of  difficulties  that  arise  i 


n 


the  first-crder  case*  We  simply  take  it  on  faith  that  this 
requirement  is  met* 


The  test  "GI-”  is  only  applied  to  nonraodal  forraulas  p*  Given 
the  above  caveat,  this  is  equivalent  to  GsKp,  which  can  be  checked 


by  a  standard  propositional  theorem  prover^ 


Now,  quoting  [Rosenschein  81  ]  I 

The  formula  r/a  is  found  by  taking  the  conjunction  of 
the  set  of  fortaulae  each  of  which  is  a  disjunction  ox  a 
set  oi'  qi  taken  from  the  '’right  hand  side”  of  the  dynamic 
axioms  of  G  (pi=>[a]qi)  such  that  the  disjunction  of  the 
corresj onding  pi's  is  implied  by  r*  Dually,  a\s  is  found 
by  taking  the  disjunction  of  the  set  of  formulae  each  of 
whicli  is  a  conjunction  of  a  set  of  pi  drawn  from  the  "left 
hand  side”  of  the  dyim»nic  axioms  of  G  such  that  the 
conjunc  tion  of  tlie  corresponding  qi's  implies  s* 

Consider  the  followirife  sample  axioms: 
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A  3  [  a  ]  (  li  V  C  ) 

G  3  [  a  J  -» B 

(  F  A  E )  r)[  a  1  D 

In  this  case»  a\(C  v  D)  =  (A  a  G)  v  (F  a  E)«  The  reason 
for  this  Is  that  (D  v  C)  conjoined  with  -•B  iniijlies  (C 
V  D)  »  so  the  conj\inction  of  the  corresponding  left-hand 
sides  (A  A  G)  Is  one  disjunct  of  a\ ( C  v  D) •  Likewise*  the 
forniula  D  alone  implies  (C  v  D)  *  making  the  corresponding 
left-hand  side  (F  a  £)  the  second  disjunct*  These  fwo 
cases  exaust  the  possibilities  for  getting  (C  v  D)« 

Rosenschein  does  not  present  a  proof  that  •' / "  and  ‘'X"  as  outlined  do 

Indeed  calculate  the  strongest  px'ovable  postcondition  and  weakest 

provable  precondition*  Section  4*5  of  tliis  thesis  shows  the  value 

of  r/a  is  a  post  condition,  but  still  lacks  a  proof  tiiat  it  is  the 

strongest  postcondition;  and  similarly  for  a\s*  Nonetheless,  '»/•» 

will  continue  to  be  used  for  stongest  provable  postcondition,  and 

’’X”  for  weakest  provable  precondition* 


The  description  of  '•/”  and  ••X*'  suffices  in  the  propositional 
framework  because  there  is  only  a  finite  number  of  dynamic  axioms* 
Cne  may  siirply  form  all  possible  disjunctions  of  the  “left  hand 
sides”,  for  example,  and  test  whether  they  are  implied  by  s*  In  the 
first-order  case,  we  have  to  deal  with  dynamic  axioms  containing 
quantifiers,  and  explicitly  discuss  how  formulae  containing 
variables  are  progressed  and  regressed*  In  order  to  extend  the 
propositional  techniques,  we  must  be  able  to  determine  all  the 
relevant  ’’instances”  of  tiie  quantified  dynamic  axioms;  the  main 
work  of  this  thesis  is  to  show  how  a  proof  method  known  as  ’’answer 
extraction”  can  be  employed  to  this  end* 
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2«4«8  H  i  era  rctil  c  al  Plannini^ 

Tlie  key  ot>B  erva  t  ion  in  exteiidiii4;  the  single— level  algorithm  to 
multi-level,  hi  e  rar  c  li  ica  I  planning  is  that  an  atomic  action  at  level 
k  is  a  plan  to  be  solved  at  level  k+1*  This  point  of  view  is 
possible  because  of  the  way  the  planning  problem  was  fornallzed* 
The  syntactic  form  of  a  dynamic  axiom  in  Gd  is  precisely  the  same  as 
a  plan  constraint  in  RES* 

F’ormaliy,  a  hierarchical  planning  problem  is  a  tree  of 

B i ngl e— 1 e ve 1  problems*  If  <VOC  =<PROP  ,  ACT  >,  G  ,  RES  (u  ) )>  is 

k  k  k  k  k  k 

the  problem  at  non-leaf  node  k,  then  node  k  has  one  successor  for 
each  a  in  ACT  ,  and  that  successor's  problem  has  the  form 


k  ,  i  k 


<voc 

tC  *G* 

(a  )>  where  G*  denotes 

the 

subset 

of  dynamic  axioms 

k+1  lc+1 

k  ,  i 

of 

G  having 

the  form  p=3[a  ]q* 

I  n 

other 

words,  the  domain 

k 

k,  i 

constrai nts  on 

the  primitive  "a"  at  level  k 

bee  ome 

plan  constraints 

a  t 

level  k+1* 

An  overall  solution 

is 

then 

a  plan  using  the 

vocabulary  of  the  leal  nodes  that  satisfies  the  requirements  of  the 
root  node* 

f'or  any  node  k,  only  the  successor  nodes  corresponding  to 
fictions  actually  used  in  the  solution  need  be  solved*  Furthermore, 
tlic  existence  of  a  solution  for  each  of  these  nodes  guarantees  the 
existence  of  an  overall  solution*  The  re la  ti onship  between  levels 
in  the  hierarchy  is  precise!;^  defined  as  "correctly  implements"* 
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2  *4  *9  Svjn-.i.iu  ry 


Like  t  lie  situational  calculus*  Ro  sen  sche  i  ii  •  s  framework  provides 
both  a  firoof  theory  and  semantics  for  planning  (and*  as  well*  is 
forced  to  deal  with  explicit  frame  axioms).  As  in  the  state-space 
planners*  search  is  separated  from  theorem  proving*  which  is  hidden 
In  auxlliai*y  functions.  The  DIGREiJS  algorithm  provides  a  **hook'*  for 
adding  search  heuristics.  Tlie  limitations  of  S'lRIPS  type  operators 
are  abandoned.  The  general  proajression  and  regression  operators 
incorporate  the  model-updating  operations  of  STRIPS  and  its  progeny 
as  special  cases.  Bidirectional  search  can  offer  considerably 
better  performance  than  unidirectional  search  [Nilsson  80]. 
Sacerdoti’s  "hierarchy  of  abstraction  spaces"  is  given  a  formal 
definition.  Not  only  may  actions  be  described  in  greater  or  lesser 
detail  at  the  various  levels*  but  entirely  different  actions  may 
appear*  and  the  world  may  be  described  using  different  vocabularies. 
Tfie  exact  hierarchy  prevents  unhappy  clashes  between  subplans*  as 
does  the  exact  hierarchy  obtained  by  the  use  of  NACROPS  and  BIGOPS. 


It  must  be  admitted  that  some  of  the  comparisons  with  earlier 
systems  are  not  really  falrl  BIGRESS  gains  much  of  its  generality 
(as  in  it*s  handling  ail  kinds  of  disjunctive  and  conjunctive  goals 
and  state  descriptions)  by  avoiding  some  of  the  particular  issues  of 
efficiency  which  led  to  STRIPS.  In  any  case*  the  descriptive  power 


of  dy  nami c  logic  makes  it  a  p  owe  r f ul  tool  for  formally  com par i ng  and 


evaluatiru  various 


planning  strategies. 


CHAPTER  3 


A  FIRST-CREER  JDYNAWIC  LOGIC 


3.1  THE  LANGUAGE 

There  is  no  one  first-order  dynamic  lo^ic;  many  ionics  have 
been  defined  which  fall  under  this  rubric  [Harel  79].  The  basic 
plans  y  or  actions,  with  which  workers  in  program  verification  are 
concerned  relate  worlds  with  differing  interpretations  of  some 
functions  (i.e.  program  variables);  we  are  instead  most  interested 
in  actions  which  affect  only  the  extensions  of  predicates  (e.g«,  the 
truth  value  of  on(BLOCK9,  TABLE)  is  changed  by  the  action 
p ickup ( BLOCK9 ) ) •  The  rest  of  this  chapter  gives  the  syntax, 
semantics,  and  axioaatics  of  a  language  I  call  Transparent  Dynamic 
Logic,  designed  to  express  Just  such  actions.  The  general  outline 
follows  [Harel  79],  but  tlie  particular  formulation  of  actions  with 
parameters  and  transparency  conditions  is  original. 
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P.2  SYNTAX  ; 

De±iii<‘  the  sets  of  symbols! 

VAR=variables 

CON  =  constants 

PRED ( J ) =pre dica t e  symbols  of  ari ty  J,  for  J=0tly2f.«. 

PRED(2)  Includes  at  least  ”  = 

ACT ( J ) = ac t i on  symbols  of  arity  J,  for  J=0flf2y... 

Let  TEkNS=VAR  u  CON 

PRED=PPED(0)  u  PRED(l)  u  ... 

ACT=ACT(0)  u  ACT(l)  u  ••• 

The  well-forraed  formulas  and  plans  of  TDL  are  defined  by  mutual 
recursion.  ♦  An  atoa^ic  fojrmula  is  an  n— ary  predicate  symbol  followed 
by  n  terms.  An  atomic  ac_tJ.on  is  an  n-ary  action  symbol  followed  by 
n  terms.  The  terms  are  the  L<arame_ters  of  the  action. 


1.  An  atomic  action  is  a  TDL— plan. 


2.  Wiiere  P  is  a  non-raodal  TDL-wff,  and  AyB  are  TDL.-plans»  then 
null,  (A;B),  (a  U  H),  and  P?  are  TDL-plans . 


3.  An  atomic  formula  is  a  TDL-wff. 


4.  Where  x  e  VAR,  P,0  e  TDL-wffs,  and  A  e  TDL-plans,  then  -.P, 
(  PvQ )  ,  L'  X  P,  and  <A>P  are  TDL— wffs. 


A  non-modal  TDL-wff  is  a  TDL-wff  contoinint,  no  TDL-plan.  (I.e.,  a 
formula  of  func t ion-f ree  first-order  logic.)  We  make  the  following 
abbrevi a  t i on  s : 


♦  Note  on  typography!  Hv'*  is  orj  "a"  is  and!  n-i"  is  not 
implies!  •<=•»  is  two-way  implication!  is  member!  "u" 
union!  "c*'  is  subset;  "E"  is  tlie  existential  quantifier 
the  universal  quantifier. 


"3"  is 
i  s  se  t 

*'¥"  is 


9 
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[A] 

for 

-.<A>-i 

Vx 

for 

^E  x-» 

P  A  0 

for 

-.P  V  -.0 

P  D  0 

for 

-.P  V  Q 

P  =  (J 

for 

(P  3  Q)a(C 

=>p) 

tl?tt2 

for 

-.( t  l=t2) 

true 

for 

p  V  -^p 

false 

for 

p  A  -»p 

(P  -A,B) 

for 

((p?;a)  u 

(-iP?;b)  ) 

The  plan  (P  -•  A»B)  corresponds  to  the  more  familiar  programming 
language  construct  IF  P  THEN  A  ELSE  B* 

A  list  of  variables  j(ly*«*yxn  will  often  be  abbreviated  as  X» 

as  in 

(EX)  P  for  Exl  Ex2  •••  Exn  P 

In  general*  a  capital  letter  standing  in  a  place  where  a  variable  is 
expected  will  stand  for  a  list  of  variables*  Constants  will  always 
be  capitalized* 

A  particular  dialect  of  TDL  is  specified  by  its  vocabulary* 
<CON,  PRED,  ACT>* 

A  plan  a  is  in  normal  form  if: 

(1)  B  can  be  written  as  Al;A2;***:An  with  at  most  one  Ai  not* 
a  tomi  c  ‘t  and 

(il)  Such  an  Ai  is  of  the  form  (TEST  -♦  BlyB2)t  where  TEST  is  a 
nonmodal  wff  and  Bl  and  B2  are  in  normal  form;  and 

(ill)  Put  in  prenex  form*  TEST* s  quantifiers  are  either  all  ¥ 
or  all  E  * 

Unlike  the  propositional  case*  TEST  cannot  always  be  made  atomic* 


The  need  lor  condition  (ili)  is  discussed  in  section  4*4 
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3.3  SEMANTICS 

j 

A  structure,  or  interpretation,  of  TDL  Is  a  triple  <DOM ,  WD ,  ni> 
where  DOM  is  a  domain,  WD  a  set  of  worlds,  and  ni  is  a  function  which 
interprets  the  action  symbols.  Each  world  interprets  the  terras  as 
inerabers  of  the  domain,  and  the  predicate  symbols  as  predicates  over 
the  domain.  In  an  acceptable  transparent  structurel 


1  . 
2. 

3. 

(d/x)  I  , 

4. 


The  meaning  of  *'  =  '•  is  fixed  as  equality. 

Constants  receive  the  same  interpretations  in  all  worlds. 

For  any  world  I,  variable  x,  and  entity  d,  W  contains 
a  world  Just  like  I  except  that  x  is  interpreted  as  d. 

Actions  are  transparent,  as  explained  below. 


A  meaning  function  M  interprets  a  plan  as  a  binary  relationship 
over  WD  (i.e.,  a  set  of  pairs  of  elements  of  WD ) ,  using  m  to  map 
action  symbols  to  functions  from  entities  to  binary  relations  over 
WD.  We  define  M  and  truth  in  a  world  I,  written  l|=,  as  follows. 

I|=  p(tl,...,tn)  iff  I(p)  (I(tl)  ,..  .,  I(tn) ) 

where  I(p)  is  the  interpretation  of  predicate 
symbol  p  and  I(ti)  is  the  Interpretation  of 
terra  ti  in  world  I. 

I  I =  tl=t2  iff  I (t )  =  I ( t2) 

l!=  -.P  iff  not  I|=P 

I|=  P  V  g  iff  lI=P  or  ll=Q 

ll=  Ex  P  iff  for  sorae  d  e  DOM,  (d/x)ll=P 

l|=  <A>P  iff  lor  some  J  e  \^D, 

(  I,J)  e  M( A)  and  J j =P 


WxW 

Define  M:  TDL-plans  -•  2  ,  where 

J  WxW 

( :  DOM  -  2  ) 


m:  ACT(J) 


A  M  K’ST-CiK*  OJ  W  DYNAMIC  LOGIC 


Paye  28 


as  I’ollows: 

M(a('tl|«»*f‘tn))  —  I 

(lyj)  e  m(a)(l(tl)f***tl^(  tn  )  )  } 

M(null)  =  i:(  I,  I)  I  I  €  WD) 

M(A  U  P)  =  M(A)  u  M(B) 

=  ((  I  ,  J )  I  (  I, J)  e  M( A)  or 
(  I , J)  e  M( B) } 

M(P?)  =  ((1,1)  I  I|=P) 

M(A;B)  =  ^(A)  o  M(B) 

=C(I,J)  I  Exist  K  €  WD  such  that 
(I,K)  e  M(A)  and  {K,J)  e  M(B)) 

Condition  (2)  requires  that 

I(C)=J(C),  all  I,J  €  WD,  C  e  CON 

The  null  action  simply  takes  any  world  to  ItselT,  while  a  test 
action  P?  is  the  Identity  relation  restricted  to  worlds  where  P  is 
true.  One  can  derive  semantics  for  the  normal  conditional  forml 

M(P  -  A, B)  =  C( I , J)  I 

Either  l|=P  and  (I,J)  e  M(A) 
or  l|=-.P  and  (I,J)  e  M(B)} 

The  definition  of  M  for  atomic  actions  indicates  that 
parameters  are  evalutated  in  the  initial  world*  Condition  (3)  above 
Insures  that  all  quantified  formulas  can  be  interpreted* 

The  transparency  conditions  on  actions  allow  substitution  of 
terms  through  modal  contexts*  For  example,  from 

Vx (box (x ) pickup ( x )  ]hold (x )  ) 
we*d  like  to  conclude 

box(Bl):D(  pick  up  (Bl)  ]hoid(Bl) 

but  nothing  so  far  assures  that  x  has  the  same  interpretation  before 


and  after  pickup(x). 


and  that  the  only  input  to  pickup  is  its 
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pai'umeter*  The  req  u  ireraeri  t  is:  ^ 

(l^J)  €  V.  { A)  ^  I('t)=J(t),  any  t  erm  t »  any 

atomic  action  A 

€  M(a(tlf»*«tn))  ^ 

(  (d/x)  I,  Cd/x)  J  )  e  M(a(  1 1  ,  .  .  •  ,  tk)  ) 
for  any  d  e  DCM,  x  e  VAR, 
whenever  x  is  not  one  of  1 1  , •  •  •  ,  tk 

The  result  of  all  this  is  that  only  quantifiers  will  bind  variables* 

Saj'  S  is  a  structure  and  P  is  a  TDL-wff.  S  satisfies  P  if  P  is 
true  in  every  world  in  S*  P  is  vaJ^d,  written 

1=  P 

it  every  transparent  structure  satisfies  P*  Where  C  is  a‘  set  of 
formulas  (axioms),  y>G  write 

G  1=  P 

to  mean  that  every  transparent  structure  which  satisfies  all  of  G 
satisfies  P* 


3.4  AXIOMATICS 

The  axloins  and  rules  of  inference  include  all  those  for 
function-free,  first-order  lo*jic  with  equality  and  loop-free  dynamic 
loi^ic*  1’  and  Q  will  stand  for  any  TDL-wff,  and  A  for  any  atomic 
action*  ’’The  tern  t  is  a  parameter  of  atonic  action  A**  is 
abbreviated  t  e  A*  The  usual  notions  of  bound  and  free  occurences 
of  a  variable  hold*  For  example,  x  is  free  in  the  wff 
[drop{x)J  onfloor(x) 

We  wr 1 te 
P (t/x) 

for  the  formula  obtained  by  substituting  term  t  for  all  free 
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occureiiceH  of  x  in  formula  PI 


xCt/x)  =  X 

s  Ct/x)  g  for  any  tern)  s  other  than  x 
(  1 1  ,  .  .  .  ,  tn  )  {  t/x  )  =  p  ( 1 1  (t /x)  »  •  •  •  f  tn  (t /x}  ) 

(-.P)  Ct/x}  =  -(P  Ct/x}  ) 

(P  V  0)(t/x}  =  (  P  {t/x}  V  Q  (t/x3  ) 

(  Vy  P )  (t/x)  =  Vz  ((PCy/z})(t/x})  new  variable  z 

( [ a ( 1 1  ,  •  .  .  ,  tn  )  ] P  )  {t/x}  = 

[  a  (  tl  { t/x}  ,  •  •  •  t  tn  Ct/x}  )  }  PCt/x} 


first  order 


Al«  All  tautologies  of  propositional  calculus 
A2.  Vx(P  '})  =>  (VxP  3  ¥x  Q) 

A3«  VxP  ^  P  Ct/x}  t  for  any  term  t 
A4«  P  =>  VxP  f  where  x  is  not  free  in  P 

modal 

A5.  [A](l'  rj  Q)  r)  (Ca]P  =>  CA}Q) 

A6.  [  P?  ]<J  5  (  P  =)  Q  ) 

A7.  [ null ] P  =  P 

A8.  [A]C B}F  5  CA;B]P 

A9.  [A  U  B]P  5  CA}P  A  [B}P 

AlO.  Vx[A]P  3  CA}VxF  ,  if  X  /  a 


equa 1 i ty 


All*  ¥x( x-x ) 

Al2*  tl  —  t2  3  (p(«*«ytlf«*«)  3  p(*«*yt2y*«*)) 

all  p  €  PPEE 
A13«  Vxy(x=y  3  [A]  x=y) 

A14*  Vxy(xAy  =>  [A]  xj^y) 


rules  of  inference 
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R1  • 

F  roiT) 

Pt  P^Q  com 

c  1  ud( 

K2. 

F  rom 

P  conclude 

VxP 

R3. 

From 

P  conclude 

[  Aji 

The 

axi oma t i za  t 

ion 

If  GKP 

then  G 1 =P 

The 

only 

non— sta  nda  r 

d  ax 

subs  tl tut 

i on  s  allow 

ed 

c  ondi t i on 

s  enforce  t 

he  t 

Barcan  fo 

rmula  of  mo 

dal 

s tructur  e 

as  contain 

ing 

e  ve 

r  wi  s 

hed  to  mo 

del 

enti ties • 

The 

axi  oniat  iza  t 

i  on 

If  g|  = 

P  then  Gl-P 

Since  we 

only  give  p 

ar  t  i 

w  on 

•  t  ta 

Ik  about 

corap 

f  orrnul  as 

in  a  particular 

demonst ra 

te  comple 

t  e 

ciomatizations  of  loop- free  first-order 
dynamic  lo4.ic  where  the  onl^^  primitive  actions  are  test  and 
assignment* ) 


3.5  LEMMAS 


Some  useful  derived  rules  of  inference  are 
DRl:  From  conclude  VxP  ^  VxQ 


DR2 


II 


ExP  =>  ExQ 
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DR  3: 

II 

[A]r 

[A]Q 

DK4 : 

II 

<A>P  3 

<A>0 

The  lollowinji  siaple  theorems  of  TDL  shall  prove  helpful 

well  • 


IHl:  If  P  is  a  TDL-wff  and  a  valid  formula  of 

flrst-oi’der  logic  with  equality,  then  l-P« 
Proof  1  Obvious,  since  TDL  incorporates 
POLE. 


TH2:  If  GP  P^g  then  Gu  fP}l-  Q. 

Proof-  PI  applied  to  GuCP}!-?,  Gu(P)»-  PoQ, 

The  reverse  does  not  hold* 


Leniiua:  »-  Ex£A]P  rs  [AlExP,  if  x  /  A. 

Proof : 


1* 

Vx-»P  =>  -^P 

A3 

2* 

Vx<  A>¥x-.P 

3  Vx<A>-*P 

1  , DR4, DRl 

3. 

<A>Vx-iP  3 

Vx<A>Vx-.P 

A4 

4* 

<A>Vx-.P  3 

Vx<A>-.P 

2, 3, PC 

5* 

Ex  [  A ] P  3 

[ A  ]ExP 

4,  PC 

TH3:  H  K[A]P  3  tA]KP 

where  K  is  a  sequence  of  quantifiers,  and 
none  of  the  quantified  variables  appear  in  A* 
Proof:  Induction  on  the  length  of  K, 

using  AlC  and  TH2* 

This  theorem  allows  us  to  "push"  quantifiers 
through  actions* 


TH5:  ([A]P  A  [A]Q)  3  [A](P  a  C) 

TH6:  ([A]P  v  [A]Q)  3  [A3(P  v  0) 

Proof:  These  are  true  for  any  dynamic 

logic;  see  [Hare!  79 J * 


as 
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We 

n  ow 

ne  ral 

c  hap  ter 

2 

to 

ha  n 

DIGRESS 

1  s 

ext 

ended 

The  not 

1  or» 

o 

f  pi 

general 

t  ha  n  t 

ha  t  o 

goals*  a 

nd 

wi  i 

1  pro 

planni ng 

• 

The 

p  rog 

de  ta 11* 

I’  i  n  a 

iiy  ♦ 

8  tra  t  egl 

es 

for 

t  he 

i2.e  the  propositional  Iraniework  described  in  the 
die  a  subset  ol  first-order  planning  problems* 
to  plan  to  satisfy  mulfiple  plan  constraints* 
annin^:  to  satisfy  multiple  constraints  is  more 

i  plannin45  to  achieve  multiple  (conjunctive) 
ve  useful  In  the  later  discussion  of  hierarchical 
ression  and  regression  functions  are  discussed  in 
some  comments  are  made  on  suitable  control 
non-de termini s tic  DIGRESS  algorithm* 


4*1  FORMULATION  OF 

Since  TDL  incor 
decidable.  It  is  a* 
decidable  for  first— 
so  that  ail  un 
existential  1  y  —  cju  anti 
attention  to  a  clas 


A  PLANNING  PROBLEM 

p  ora  t  es  f ir s  t — or d  er  logicf  it  obvl ously  no  t 
eli— known*  however*  that  the  validity  problem  is 
order  formulas  which  can  be  put  in  prenex  form 
ivet sally-quantified  variables  preceed  all 
fled  ones  (Ackermann  1954]*  We  restrict  our 
s  of  planning  problems  which  can  be  solved  using 
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only  first-order  reasonin^i  about  formulas  of  this  form* 

A  prenex  wff  or  set  of  wffs  which  in  all  V-quantif iers  appear 
before  aJ  1  F— quan t i  1  iers  is  •'¥— first*';  the  converse  is  "E— first"* 

A  plannJ.n^  iiHOblera  is  a  triple  <  VOC  »  G  ,  RES  (  u  (  H  )  )  >  where: 

1*  VOC  =  <CON, PKED f ACT>  is  the  vocabulary  of  the  problem:  the 

particular  dialect  of  TDL  to  be  used  in  synthesizing  a  solution* 
The  vocabulary  (in  particular^  CON)  is  finite* 

2*  G  is  a  set  of  axiorast  the  domain  constraints*  It  contains: 

GSf  the  static  axioms*  a  finite  set  of  E— first  non-modal 
f ormul as* 

Gd*  the  dynamic  axioms*  a  finite  set  of  formulas  of  the  form: 

(V  Y)(p  ^£a(Z)]  q) 

Y  is  a  list  of  variables  and  2  is  a  list  of  terms  such  that  Y 
contains  any  variables  in  Z;  p  and  q  are  non— modal 
quan t i f i er- f re e  formulas  all  of  whose  free  variables  are 
contained  in  Y*  Where  Z  is  of  length  J*  a  e  ACT( J) * 

Ge*  a  special  set  of  axioms  of  the  form 

Cl  ^  C2 

for  all  Cl*  C2  e  CON*  Cl  not  the  same  as  C2* 

3*  PES(u(H) )  is  a  set  of  k  plan  constraints*  each  of  the  form 
(V  Y){r  ^  [u(H)]  s) 

X  is  a  list  of  variables  and  H  a  list  of  terras  such  that  X  contains 
any  variables  in  H;  r  is  a  non— modal*  E— first  wff;  s  is  a 


non— modal*  V— first  wff; 


and  the  free  variables  in  r  and  s  fall  in 
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X«  The  voriahTes  in  H  are  called  "the  ® • 

; 

A  so_lu^_ion  is  a  noi'oiai  — f  orin  pian  B  such  Thai  subs  "t  i  tu  ti  B  for 
u(H)  in  4'ach  plan  constrainf  creafes  a  tlieorem  clerivabie  from  Gf  and 
the  only  free  variables  in  B  are  the  probieni  parameters*  H  may  be 
thought  of  as  the  "input"  to  the  plan* 

For  example!  if  RES(u(li))  is 

(V  h)(t>iock(h)  ^[u(h)]  inbox(h)) 

(V  h  X  )  (  ( -li  nbox  {  X  )  a  x^h)  =>[u(h)]  -linboxCx)) 
the  constraint  is  to  find  a  pian  to  put  any  biock  h  into  the  boxt 
without  putting  anything  eise  into  the  box*  The  only  input  to  the 

pian  will  be  the  particular  block  to  be  moved* 

Constants  are  made  pairwise  disjoint  mainly  as  a.  matter  of 
convenience;  in  tiie  examples  which  will  be  presented!  free 

variables  are  used  in  place  of  non—unique  constants*  We  are  not 
assuming  that  there  is  a  constant  for  every  entity  in  the  domain 
(unless!  of  course!  Gs  specifically  includes  a  domain  closure 
ax  i  om  )  * 

We  define  a  frame  axJ,om  as  a  dynamic  axiom 

(¥  T)(p  ^[a(Z)]  q) 
sucfi  t l»a  t 

Gh  ( ¥  Y) ( p  o  q ) 

A  i>ure  ^rain®  ®  one  o  f  the  form 


(  ¥  Y  )  (  p  =»  (  a  (  Z  )  ]  p  ) 
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A  predicate  p  €  RRED(j)  is  invariant  in  G  if  for  any  a  e 
ACT(k),  lists  of  variables  Y  and  Y*f 

Gl-  (V  Y  Y»)(  p(Y)  3  [a(Y')]  p(Yn 
CF  (V  Y  Y*)(  -^p(Y)  =>  [a(Y')]  -ip(Y)) 
hold*  Note  that  is  invariant* 

4*2  DIGRESS  ALGOJSIIDM 

We  review  and  extend  Fosenschein  •  s  bi4,ression  alfeorithm* 

The  function  calculates  the  strongest  pi'ovable 

post  cotidi  t  i  on  of  a  condition  and  an  action»  calculates  the 

weakest  provable  p  r  econdi  t  ion »  and  •'GF'*  takes  as  input  a  non— modal 

formula  P,  and  decides  whether  P  is  provable  frora  G*  Where 

FFS(u(H) )  is  the  set  of  wffs 

C  (V  Yl)(rl  =»  [u(H)]  si),  ***  ,  (¥  Xk)(rk  =>  [u(H)]  sk )  ) 

A  is  an  atomic  action,  and  TEST  a  wff,  define 

R  =  [i'l,***,rk) 

S  —  (sl,***,sk} 

P/A  =  { r 1 / A , *  *  * , rk/ A) 

A\S  —  Ca\s1,**  *,A\s13 

k  A  TEST  =  Crl  A  TESI,***,sk  a  TEST) 

V 

An  acceptable  plan  is  returned  by  callinei  BIGkESS(k,S)  *  Assume 
dynamic  scoping  of  F  and  S  for  recursive  calls  within  DIGRESS* 
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BIGRESS( K  »  S )  : 

; 

If  Gl-  rl  3  si  for  l<=i<=k 
tlieii  return(  null  )• 


C  h  o  o  s  e  I 


Choose  <  A  » 
r t' t  urn  ( 


R/ A>  from  L ivelorward( R ) : 

a;bighess(  r/a,  s  )  ) . 


Choose  <A» 
re  t  urn ( 


A\S>  from  1 1 vebackwar d ( S ) I 
BIGRESS(  R,  A\S  );A  ). 


Choose  TEST  from  NonTriv(R) I 

return(  TEST  -•  SuhPlanl»  SuhPlan2  )  where 
SubPlanl:=  B1GRESS(  R  a  TEST,  S); 
SubPlan2:=  BIGRESS(  R  a  -.TEST,  S). 

end* 


L Ivef orwo rd ( W ) Z 

return((  <a ( t 1 , • • • , t J )  ,  R/ a ( 1 1  ,  •  •  • , t J ) >  | 

a  e  ACT ( J )  ,  tl  e  CON  u  H  for  l<=i<  =  J,  and 
for  SOME  ri  e  R, 

no  t  GH-  rl  =  rl/a(tl,***,tj)  ))• 


L 1 vebackwar d ( S )  : 

re  turn (C  <a(tl,***,tj),  a(tl,***,tJ)\S>  | 

a  €  ACT(J),  tl  e  CON  u  H  for  l<=i<=J,  and 
for  SOME  si  €  S, 

not  GK  a  (  t  1 ,  .  .  .  ,  t  J  ) \sl  =>  si  }  ) 


NonTrlv( R )  : 

re  turn (  (  TEST  |  lEST  Is  a  non-modal  TDL-wff , 
all  free  variables  of  TEST  are  In  11, 
test's  quantifiers  are  either  all  V  or  all  E, 
and  for  SORE  rl  €  R, 
not  GH  ri  =>  TEST 
not  GH  rl  ^  -ifEST  )  ) 


A 1 1  eiai^  1 1  ny  to  choose  from  an  empty  set  is  equivalent 


to 


f  al  1 1  045 


It  may  be  desirable  to  impose  further  restrictions  on 
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tests!  lor  example*  only  allow  predicates  which  directly  coriesjond 
to  the  I'obot's  sensory  inputs*  Thus*  *’handenjp ty "  might  be  a 
legitimate  test*  but  not  " ins ide ( BLKl * BOX2 ) "  since  BLKl  would  be 
hidden  Irom  view* 


4*3  COkPPCTNESS  ANE  COMPLETENESS  CF  BIGPESS 

Define  correctness  and  completeness  of  the  implementations  of 
the  auxiliary  functions  "GH*'*  "/"»  and  <'\*’  as  follows! 

For  any  atomic  action  A*  non— modal  wffs  p*  r*  s! 

1*  Correctness! 

a)  If  '’GHp”  returns  true  then  p  follows  from  G* 

b)  GP  r  3  [A]  r/A 

c)  GP  A\s  3  [Aj  s 

2*  Completeness! 

a)  If  p  follows  from  G  then  "GPp*'  returns  true* 

b)  If  GP  r  3  [A]  s  then  GP  r/ A  3  s 

c)  If  GP  r  3  [A]  s  then  GP  r  3  A\s 

Defini  ti.pn!  BIGKESS  is  correct  if  it  only  returns  solutions! 
i*e**  for  any  plan  E  returned  by  B IGJRESS  (  R  *  S  )  * 

GP  (V  \i)(ri  3  [E]  si) 

for  each  wfl  (V  Xi)(ri  3  [u(H)]  si)  e  RES(u(H))*  and  the  onl  y  free 
variables  in  B  are  in  H* 

The  definition  of  the  c  oiap'l  e  t  ene  s  s  of  DIGRESS  uses  the  notions 
of  an  esseritiai  solution  to  a  planning  problem*  and  of  two  solutions 


being  essentially  the  same* 
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De;f  1  ni  t  ion  I  B  is  an  essential  solu_ti.on  to  a  planninti  problem 
if  any  norraal-forno  plan  B*  foi'med  from  B  by  deleting;  any  atomic 
actions*  and/or  replacing:  any  conditional  form  (TEST  -•  BlfB2)  by  one 
of  Its  branches  Bl  or  B2  is  nojt  a  solution* 

Def  ini  t  ion ;  A  pian  B  is  ess en_t^a_liy  the  same  as  a  plan  B*  if 
B*  can  be  obtained  from  B  by  inserting  and/or  deleting  null  actions* 

Del initionl  BIGRESS  is  complete  if  it  can  find  a  solution 
which  is  essentially  the  same  as  any  normal-form  solution  B  to  a 
given  planning  problem* 

We  prove  the  correctness  and  completeness  of  BIGRESS  relative 
to  the  correctness  and  completeness  of  "Gl-”*  "/"*  and  *'\"*  Sections 
4*4  and  4*5  demonstrate  the  correctness  of  the  suggested 
implementations  of  the  auxiliary  functions,  and  discuss  some 
problems  that  arise  in  trying  to  obtain  completeness*  No  actual 
proof  of  completeness  is  given* 

4*3*1  Correctness  Cf  BIGRESS 

Theorem:  Given  the  correctness  of  "Gl-",  "/",  and  "X"  (l(a)-(e) 
above),  BIGRESS  is  correct*  Proof: 

Let  B  be  a  plan  returned  by  B  IGRESS( R , S ) *  Its  length  |b|  is 
the  number  of  non— null  tests  and  actions  in  B*  Attach  the  phrase 
"for  all  i,  l<=i<=k"  after  each  formula  involving  ri  or  si  in  the 


f ollowi ng 
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If  lul=0t  then  B  =  null*  The  stopping  test  must  tiave  succeeded 
on  the  first  call  tc  BIORESSf  so 
GH  ri  ^  si 
By  A7  f 

GH  ri  =>  tnuii]sl 


Othei’wise  suppose  that  BIGRESS  is  correct  for  plans  shorter 
than  1b|*  On  the  first  call  to  BIGRESS*  the  algorithm  must  have 
chosen  one  ofl 


(i)  <A,  R/ A>  from  Livef orward( R) • 

BI GKESS ( R /A t S  )  returns  a  plan  B* 

1.  r  i/A  =>  [B*  ]si 

2.  [ A]ri/A  3  [A][ B* ]si 

3.  ri  =>  [A]rl/A 

4.  ri  3  [ a;B* ]si 
and  B= A  I E ' • 


such  that 
induction  hypo* 

1  ,  DR3 

"/"  correctness 

2  f  3  y  A  S 


( ii )  <A,  A\S>  from  Livehackward ( S ) • 

DIGRESS { A\Sy S )  returns  B*  such  that 

1*  ri  3  £B*  ]A\si  ind*  hyi^o* 

2*  A\si  3  [Ajsi  n\M  correctness 

3.  [h*]A\si  3  [B»][A]si  2,DR3 

4*  ri  3  [B*;A]si  ly3yA8 

and  B=B* ; A. 


(lii)  TEST  from  NonTriv(R)* 


Then 


1. 

2* 

3. 

4* 

5. 


(ri  A  TEST ) 3[ SubPlan 1 ] si 
(ri  A  -.TEST  )3[  SubPlan2  ]  si 
r i3{  (TEST3( SubPlanl  ]si )  a 
(-.TEST3[  3ubPlan2]si  )  ) 


i nd •  hypo • 
ind*  hypo* 

1 , 2 , PC 


ri3( [test?; SubPlanl  ]si  a 

[-^TEST?;SubPlan2]si  )  3,A6 

r  i  3[  TEST?  ;SubPlanl  U  -.TEST?  ;  SubPlan2  j  si 

4,A9 


That  is,  ri3[B]si  where  B  =  TEST-*SubPlanl  ,  SubPlan2 


So  in  any  case,  fl  is  a  plan  such  that 
Gt-  ri  3  [  B  ]  si 
By  P3, 

GF-  (V  Xi  )  (  ri  3  £  B  Jsi  ) 


Therefore  B  is  a  solution  to  the  planning  problem 
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<VOC,  G,  (  (V  Xl)(rl  =)  [u(H)J  si),  ...  , 

(V  Xk)(rk  o  [u(H)J  sk)  }  > 

so  DIGRESS  Js  correct. 

4.3.2  Completeness  0±  DIGRESS 

Jiieoreni:  Given  correctness  and  completeness  of  "GF*',  ,  and 

’’X”,  DIGRESS  is  complete.  ProofI 

Let  B  be  an  essential  solution  to  the  planning:  problem 
<VOC,  G,  (  (V  Xl)(rl  ^  [u(H)]  si),  ...  , 

(V  Xk)  (rk  r>  [u(D)  ]  sk)  3  > 

We  show  that  BIGRESS(R,S)  can  return  a  plan  essentially  the  same  as 
B.  Acain,  append  "for  all  1,  l<=l<=k"  after  each  formula  below. 

First,  note  that  if 

GF  (V  Xi  )  ( ri  3  [ B  Jsi ) 
then  by  A3 

GF  ri  3  (uj  si 

II  |d|=0,  then  D=nuii;  so  GFr i3 [ nul 1 ] si .  By  A7, 

GF  ri  3  si 

which  is  precisely  the  stopping  test  in  DIGRESS!  so  null  is 
re  turned • 

So  assume  completeness  holds  for  plans  shorter  than  B.  Where 

B*,B1,D2  are  plans,  A  an  atomic  action,  and  TEST  a  non— modal  wff  all 

of  whose  quantifiers  are  E  or  V,  B  is  of  one  of  the  forms! 

(  i  )  B=  A  ;  D  ' 

By  A8 

GF  ri  3  [Aj[B*]si 
and  by  •'/”  completeness 
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GH  ri/A  z>  [B«]si 

Suppose  <Af  R/A>  was  not  in  Li vef orward ( R ) •  Then 
GH  ri  3  ri/A 
which  implies 

CH  ri  3  [B* ]si 

This  would  mean  that  B*  is  a  solution  to  the  planning 
problemy  so  B  would  not  be  an  essential  solution* 

Therefore!  BIGRESS  can  choose  <Af  K/A>* 

By  the  induction  hypothesisy  the  recursive  call 
BIGRESS ( R/A y S )  can  return  a  plan  B**  which  is 
essentially  the  same  as  B**  Then  the  first  call  to 
BIGRESS  returns  A;B**y  which  is  essentially  the  same 
as  B* 

(  ii)  B=  B'  ;  A 
From 

GH  ri  3  [B*  J[ A]si  i 

proceed  to  deduce 

GF-  ri/B'  3  [A]si  h/m  completeness 

GF-  ri/B*  3  A\si  ••\n  completeness 

GF-  [B*]ri/B'  3  [B*  ]A\si  DR3 

GF-  ri  3  [B*  ]rl/B*  it/ii  correctness 

Therefor  e 

GF-  ri  3  [B*  ]A\sl 

As  beforey  it  must  not  the  case  that 
GF-  A\si  3  si 

for  then  B®  would  be  a  solution*  BIGRESS  can  choose 
<Ay  A\S>  from  Li vebackwar d ;  by  the  induction  hypothesisy 
the  call  BIGRESS ( R y A\S )  can  return  B* •  essentially  the 
same  as  B*;  and  ElGRESS(RyS)  returns  B**;A  essentially 
the  same  as  B* 

(ill)  B=  (TEST-  BlyB2) 

Given  that 

GF-  rl3[TEST-  ElyB2]si 

A6 y  A9 y  and  propositional  manipulations  let  us  conclude 
GF-  (ri  A  TEST)  3  [Bl]si 
GF-  (ri  A  -.TEST)  3  [B2]si 
Suppose  TEST  were  not  in  Nontrlv(R)*  Then 
GH  ri  3  TEST  or  GF-  ri  3  -,TEST 

But  in  tlie  first  casey  (ri  a  TEST)  =  ri  y  so 
GF-  ri  3[Bl]si 

— — i*e*y  Bl  would  be  a  solution*  Similarlyy  in  the 
second  casey  B2  would  be  a  solution*  So  TEST  roust  be 
in  Nontri v( R) * 

Flnallyy  B IGRESS( RaTEST y S )  can  return  Bl*  essentially 
the  same  as  Bly  B IGRE SS  (  Ra-iTEST  y  S)  can  return  B2* 
essentially  the  same  as  B2y  so  BIGRESS(RyS)  can 
return  (TEST—  Bl*yB2*)  essentially  the  same  as  B* 

Note  that  for  some  particular  rh  in  Ry  it  may  be  the 
case  that  GF-  rh  3  -iTESTy  so  rh  a  TEST  is  false*  So  some  of 
the  wffs  in  R  on  a  recursive  call  to  BIGRESS  may  be 
false*  Any  plan  will  then  satisfy  that  component  of 
the  constraint* 
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(  Iv)  B=  A 

The  plun  A  is  essentiuliy  the  same  as  A;null«  By 
case  (1)  BIGRESS  can  iiriot  a  plan  essentially  the  same 
as  a; null  and  thus  essentially  the  same  as  A. 

In  any  case*  B  IGK'ESS  can  return  a  plan  essentially  tlie  same  as 
t^ie  above  definition^  HIGRESS  is  corapletej  relative  to  the 
completeness  of  "Gh-"t  ”/”»  and 

4»3»3  Partial  And  Tctal  Correctness 

Discussions  of  the  correctness  of  pro^^raius  distinguish  the 
notions  of  partial  and  total  correctness*  The  plan  constraints  and 
dynamic  axioms  we  have  used  have  all  been  in  the  form  of  partial 
correctness  assertions: 
r  [  B  ]  s 

s  will  hold  in  any  state  reached  by  executing-  B  in  a  state  where  r 


holds • 

In 

particuiar»  the 

assert i on 

i s  true 

i  f  no 

state  is 

r eachabl e 

by 

3  from  one  where 

r  holds* 

What 

i  s 

desiredf  howeverf 

are  plans 

which  are 

totally 

correct : 

executing:  B  in  a  state  where  r  holds  takes  one  to  a  state  where  s 

holds;  t  iia  t  ist  partial  correctness  plus  guaranteed  termination  of 
B.  [Rosenschein  81]  remarks  that  termination  of  a  plan  (program)  E 
is  asserted  by 

1=  <n>  true 

From  any  statcf  executing  B  can  take  you  to  some  state* 

Although  this  definition  happens  to  suffice  for  normal— form 
plansy  it  is  not  always  adequate*  [Karel  79]  points  out  that  the 


meaning  of  termination  depends  upon  the  intended  method  of  plan 
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execution.  For  a  simple  sequential  rej^imef  it  is  required  tiiat  all 
execution  paths  through  P  terminate*  for  instancet  when 
B=  ( nul 1 ; fa Ise? )  U  (nuli;true?) 

then 

<B>  true 

but  the  execution  path  through  the  first  half  of  the  union  reaches  a 
dead-end  at  the  false?  test* 

The  restriction  of  ?  and  U  to  the  if— then— else  foru  ensures 
that  whenever  a  test  falls,  a  non— failure  alternative  (i*e*,  the  one 
headed  by  tlje  negation  of  the  test)  is  immediately  available*  Thus, 
dead-ends  can  arise  in  a  normal  forra  plan  only  if  it  contains  some 
a  topii  c  action  which  fails  to  terminate* 

So,  wo  require  that  any  atomic  action,  instantiated  with 

whatever  parameters,  always  leads  to  at  least  one  state* 

S  eraa  ntlcally, 

V  a  e  ACT(J) 

¥  dl , * . . ,dj  €  DOM 
¥  I  e  WD 

E  J  e  WD  such  that  (I,J)  e  m ( a )  ( d 1 , • *  *  , d J ) 

The  axioms  are  augmented  byl 

Al5*  <A>  true  ,  any  atomic  action  A 

A  simple  inductive  argument  then  shows  that  l-<B>true  for  any  normal 


forra  plan  li 
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4.4  THE  PkOVAfllLITY  TFSl 

/ 

can  i3e  i  np  Icme  n  t  ed  by  o.  conipltite  ± i  r s  t— oi*de  r  thcorciii 
prover  i  1  t!ie  noii—iriodai  ujciomSf  Gs  and  Ge»  are  strong  enouf'E  to 
derive  a  11  noii-raodal  lormuias  derivable  from  G.  When  this  is  the 
caset  tests  oJf  the  form 

GH  P  »  P  non-modal 

are  equivalent  to  tests  ot  the  form 
F  ( Gs  A  Ge  )  =>  P 


W  lien 

P  is  V- f i rs  t 

and 

Gs  E-f i r st  y 

the 

express! on 

above  is 

¥-f irst . 

The 

dec idab i 1 ty 

o  f 

this  form 

i  s 

apparent 

in  light  of 

Skolem ' s 

theorem.  The  formula  is  vaiio  i f 1  My  the  skolem  form  of  its 
ne^utiony  is  inconsistent.  M  can  contain  only  nuilary  function 
symbols;  thusy  the  Herbrand  universe  for  M  will  be  finite.  Ail 
ground  institnces  of  M  over  this  universe  can  be  generatct-i  ana  tested 
for  inconsistency# 

Care  was  taken  in  iilGRESS  to  ensure  that  the  provability  test 
was  only  applied  to  ¥-first  formulas.  Tests  were  restricted  to 
E  — only  or  V—only  forms  so  that  both  TEST  and  -tTESI  would  be  V  — first. 

Roseiischein  dismisses  as  ’’pa  tholo^^ica  !•'  cases  in  the 
propositional  framework  where  non— modal  theorems  are  derivable  from 
G  but  not  Gs.  His  example  is  the  dynamic  axiom 
p  3  (  n  ]  f al se 

which  together  with  <a>true  (A15)  allows  one  to  conclude  -^p. 

The  problem  seems  more  tangible  in  the  first-order  framework. 
Say  the  dynamic  axioms  include! 


V  y  (fj(y)  =>  [a]  q(yl) 


A 
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V  y  (r(y)  ^  [a]  -'q(y)) 

With  A15  we  can  derive  V  y(p(y)  ^  -'r  (  y )  )  • 

In  the  propositional  case  and  many  Instances  of  the  first'-order 
casof  it  is  poesible  to  mechanize  the  process  for  finding  axioms 
which  need  to  be  added  to  Gs •  Look  for  Inconsistent  sets  of  dynamic 
axiom  consequences*  and  add  as  a  new  axiom  the  negiation  of  the 
conjunction  of  the  corresponding  antecedents* 

It  is  not  always  possible*  however*  in  the  first— order 
framework*  to  make  Gs  as  strong  as  G  with  respect  to  non— modal 
theorems*  Ihe  first  example  in  section  5*2  gives  a  case  where  the 
dynamic  axioms  force  the  domain  to  be  infinite  but  such  a  condition 
cannot  be  specified  by  a  finite  number  of  E— firsf  non— modal  axioms* 

In  briefr  the  implementation  of  "GH”  that  uses  only  Gs  and  Ge 
is  correct  (as  defined  in  4*3*2)*  but  in  some  cases  not  complete* 
The  progression  and  regression  algorithms  also  assume  that  the 
non— modal  axioms  suffice  to  prove  non— modal  formulas*  and  similarly 
are  correct  but  not  necessarily  complete* 

4*5  PROGRESSION  ANE  REGRESSION 

The  j  regression  and  regression  functions  generalize  the 
propositional  functions  outlined  in  section  2*4*7*  Recall  that  the 
progression  of  a  state  description  through  an  action  was  computed  by 
finding  all  the  combinations  of  antecedents  of  the  dynamic  axioms 
which  were  ixuplied  by  the  description*  and  taking  the  conjunction  of 
the  corresponding  dynamic  axiom  consequences*  In  the  first-order 
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caset  a  single  dynaaic  axiom  may  have  a  number  of  Instances  which 
are  relevant  to  computing  the  progression!  for  examplef 


Vy(p(y)  =>[a]q(y))  has  instances  p(C)  =a[a]q(C) 


and 


(^x 


p(x))3[a](Vx  q(x))*  The  technique  of  resolution  with  answer 
extraction  [Green  1969b]  is  used  to  find  all  relevant  instances  of 
the  axioms*  Formulas  containing  free  and  and  bound  variableSf  as 
well  as  constant  terns  can  be  progressed  and  regressed* 


Section  4*5*1  and  4*5*2  outlines  the  progression  and  regression 
algorithms  respectively?  numerous  examples  follow*  Proofs  of 
correctness  appear  in  4*5*4*  The ' algor ithm »  unf or tuna tely f  is  not 
guaranteed  to  always  terminate  (although  it  does  for  the  examples  in 
this  thesis) ?  4*5*^  contains  a  discussion  of  problems  that  can 


arise*  No  proof  of  the  completeness  of  the  algorithm  is  attempted* 


4*5*1  Progression 


The  progression  of  a  state  description  D  through  an  atomic 
action  a(Z)  using  domain  constraints  G  is  calculated  in  four  steps! 

1*  Form  G(a(Z))t  "the  set  of  the  instances  of  the 
dynamic  axioms  for  action  a  with  parameter  list  Z* 

2*  Put  the  description  D  in  skolera  form*  Use  the 
antecedents  of  the  wffs  in  G(a(Z))  to  construct  an 
existential  query  on  the  skolera  form  of  Df  Gs f  and  Ge * 

3*  Generate  and  conjoin  all  answers  to  the  query* 

4*  Transform  the  conjunction  of  answers  by  replacing 
each  answer~wfl  by  a  corresponding  instance  of  a  dynamic 
axiom  consequence*  Replace  skol em— f unc t ions  introduced  in 
step  2  by  bound  variables* 
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The  four  steps  are  now  described  In  detail*^*' 

If  so»  the 
as  follows: 

Step  _lj_ 


F  i  i' s  t 


check  whether 


D 


1  s 


inconsistent. 


postcondition  is  sinply  false.  Otherwise,  proceed 


Collect  all  the  dynaciic  axioms 
including  instances  of  schema  Al5 

variables  apart.  Rewrite  the  axioms, 
antecedent  of  each  dynamic  axiom  is 
the  consequence  is  a  disjunction  of 
single  axiom 


containing  action  symbol  a, 
and  A16,  and  rename  all  bound 
if  necessary,  so  that  tlje 
a  conjunction  of  literals,  and 
literals.  For  example,  the 


VY((pl(y)  V  p2(y))  =»  [a(Y)]  (ql(Y)  a  q2(Y))) 


can  be  rewritten  as  four  axioms 


VY  (pl(Y)  3  [a(Y)]  riKY)) 


VY  (p2(Y)  3  [ a(Y  )  ]  ql(Y)  ) 


VY  (pKY)  3  [a(Y)]  q2(Y)  ) 


VY  (p2(Y)  3  [a(Y)]  q2(Y)) 


Also  rewrite  the  axioms,  if  necessary,  to  assure 


of  a  in  each  axiom  are  distinct  bound  variables. 


p  3  [a(Cl)]  q 

is  equivalent  to 

Vy((p  A  j=Cl)  3  [a(y)]  q) 


that  all  parameters 
For  example. 


^Notation:  Capital  letters  (such  as  Z)  are  used  for  lists  of 
terms,  and  small  letters  for  matrices  of  formulas.  By  p(X)  we  mean 
a  quanti  f  iei*- free  non-modal  formula  whose  free  variables  are  a 
subset  of  X;  by  p(T),  we  mean  a  formula  of  the  same  form  with  terms 
T  substituted  for  X. 
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Form  r;(a(Z)  )  t  the  Sf  l^y  substituting;,  Z  for  the 

corresponding  parameters  in  eacJi  axiom*  Let  F  be  the  free  variables 
vhlch  appear  in  D  or  Z  (l*e*t  the  plan  parameters  andy  as  described 

in  chapter  7  the  formal  objects)*  G(a(Z))  is  a  set  o±  J  formulas  of 

the  form 

(  VYi  )  (  pi  (  Yi  ,  F  )  =>  [a(Z)]  qi(Yi,F))  ♦ 

( ^e  may  I  at  this  pointy  throw  out  those  axioms  which  have 

inconsistent  an t ec enden t s «  for  exampley  when  the  substitution 

Instance  of  the  above  axiom  is 
(  p  A  C2=C1  )  =>  [  a  (C2)  ]  q 

The  more  general  form  is  required  when  the  parameters y  Zy  Include 
free  variables*) 

Step  2_I  Form  Query 


D  is  E-firsty  and  G  is  equivalent  to  an  E-first  formulay  the 

conjunction  of  all  the  static  axioms*  So  say 
D  =  (E  Xb)(¥  Yb)  d(XbyYbyF) 

Gs=  (E  Xp)(¥  Y^)  ^(Xi/yYg) 


A  query  is  an  E— quantified  non— modal  formula*  An  answer  is  a 
disjunction  of  variants  of  the  query  (  formulas  liice  the  query  with 
different  terms  substituted  for  the  E— quantified  variables) y  which 
is  a  consequence  of  the  axioms*  Mfe  wish  to  find  the  ** strongest *• 
answer  to  the  query 


♦  That  iSy  the  free  variables  in  the  antecedent  and  consequence  of 
the  wff  are  a  subset  of  Yi  u  F* 
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GHD  3((tiYl)pl(Yl,F)v 

(E  Y2)p2(Y2,F)  v 

•  •  •  V 

(E  YJ)pJ(YJ,F) ) 

— an  answer  from  which  all  other  possible  answers  can  be  derived* 
Tntultively»  we  want  to  know  all  the  ways  In  which  the  initial  world 
descriptifin  together  with  the  non  — modal  axioms  satisfy  the  action 
precondl tions* 

Our  method  is  to  ^jenerate  and  conjoin  all  answers  to  the  query 

I-  ((V  Yb)  d(Xb,Yb,F)  A  (¥  Yg)g(Xfc,Yg)  a  Ge )  3 

((E  Yl)pl(Yl,F)  V  ...  V 
(E  YJ  )pj( YJ,F)  ) 

Note  that  E— quan t i f i ers  in  the  antecedent  have  been  dropped.  We  are 
assuming  tJm  t  the  dynamic  axioms  are  not  needed  to  answer  the  query. 

Resolution  proceeds  as  follows.  The  free  variables  in  Xb t  Xgt 
and  F  at  e  converted  to  0  —  ary  skolein  functions  Xb  *  f  Xg*  y  and  F*  .  The 
base  clausc^s  will  consist  of  the  skoiem  forms  of  the  initial  world 
descript  ion  y  the  static  axioms  y  and  Gey  the  axioms  for  inequality^ 
between  different  constants, 
base  clauses! 

d(  Xb*  y  Yb  y F  *  ) 
g(  Xg*  y  Yii) 

Ge 

The  query  is  negated  and  skolemizedy  using  the  same  skolera  functions 


for  the 

free  variable  in 

F  as  before. 

Each  -.pi  (  Yi  y  F*  ) 

falls  in  a 

separate 

clause.  Following 

[  Green  61>b  ]  y 

special  "answer** 

predicates 

are  attached  to  each  query  clause  to  trace  the  substitutions  made 
for  each  variable  in  each  Yi.  The  base  clauses  are  augmented  by! 
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query  clauses:  ^ 

-•pl(Yl,F*)  V  ansl(Yl) 

-.p2{  Y2,F'  )  V  ans2(  Y2) 

•  •  • 

-'PJ(YJ,F*)  V  ansJ(YJ) 

Tlie  standard  resolution  rules  can  t)e  strengthened  with  rules 
for  equality,  such  as  paramodula  tion  (described  in  [Chang  73]),  so 
that  exf'licit  substitution  axioms  for  equality  (instances  of  schema 
A12)  need  not  appear* 

Sjtejy  £’®D®£^te  Al  1  Answers 

Create  a  br ead t h- f i rs t  tree  of  all  resolutions,  without  ever 
resolving  or  par amo dula t 1 ng  direc^J^  against  an  “ans"  literal*  Each 
answer  cl,ause  is  a  deduced  clause  containing  only  ans  literals!  a 
disjunction  of  var^^njts  of  some  of  the  ansi(Yi)*s*  In  each  variant, 
some  list  of  constants,  skolero  functions,  and  variables  replaces 
e  acii  Y1  * 

Resolution  continues  until  no  significant  new  clauses  can  be 
created,  or  (perhaps)  some  pre-established  time  limit  is  reached* 
(Section  4*5*3  discusses  some  conditions  under  which  resolution  does 
not  naturally  terminate*) 

A  double— subscripted  "ansh 1 ( Thl • ) ”  is  the  1— th  variant 
appearing  in  the  h-th  answer*  Thl*  is  the  particular  variant 
creating  substitution,  and  n(h)  is  the  number  of  of  literals  which 
appear  in  that  answer*  For  Instance,  the  second  answer  is 
ans21(T21*)  v  ans22(T22*)  v  ***  v  ans2n ( 2 ) ( T2n ( 2) * ) 
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Different  variants  cf  the  same  ansi  may  appear  in  an  answer  elause* 
Form  the  conjunction  of  ail  la  answers  I 

(ansll(Tll*)  V  •••  v  ansi n ( 1 )( Tin ( 1 )•) ) 

A  •  •  •  A 

(  ansm  1  (  fill  1  *  )  v  •••  v  ansmn  (  nn )  (  Tnin(  ni )  '  )  ) 

S_tep  Transform  Answer  Formula 

Corresponding  to  each  variant  anshl(Thi*)  is  a  dynamic  axiom 
instance  phi(Thl*,F*)  ^  qhl( Thl *  t  F  *  ) •  Subs t i tut  e  lor  each 

anshl(Thl*)  in  the  conjunction  of  all  answer  clauses  the 
c  o  r  !•  e  s  po  nding  qhl(Thl*fF*)* 

(qlKTll*  ,F»  )  V  ...  V  qlndXTlnd)  SF*) 

A  •  •  •  A 

( qra 1 ( Tm 1  *  f F *  )  v  ...  v  qmn ( m )  ( Tmn ( m )  • f F •  )  * 

Let  U  jL>e  the  list  of  all  variables  which  appear  in  any  Thl*. 
Let  Thl  l»e  obtained  frcra  Thl*  by  replacing  terms  from  Xb  *  »  Xg  *  ,  or 
F*  by  tkie  original  variables  fioia  Xb  f  Xg»  or  F.  The  strongest 

provable  postcondition  is  then 
(  E  Xb  )  (  E  Xg  )  (  ¥  U  ) 

{  (qd(Tll,F)  V  ...  v  qlnd  )  (Tin  (1  )  ,F  )  ) 

A  ...  A 

(qr.il(TmlyF)  v  ...  v  qmn(in)(Tmn(m)yF))  ) 

4.5.2  Regression 

The  outline  of  the  regression  algorithm  miri'ors  the  progressive 
case.  The  task  is  to  find  the  instances  of  the  dynamic  axioms  whose 
consequences  iiapiy  the  state  description.  The  existential  query 
formed  by  the  algorithm  is  the  contrapositive  of  this  implication: 

♦  Formulas  of  the  above  form  are  abbreviated  as 

( q 1 1 ( Tl 1  *  , I  *  )  vA  etc)  in  the  following  sections. 
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It  asks  for  the  disjunction  of  net,ated  dynamic  axiom  consequences 
which  are  implied  hy  the  negation  of  the  state  description* 

Step  1_J_  Q.L^S?:A1 

Gatt>er  tlie  axioms  for  a  and  form  the  Z  — instance  of  a  as  before* 

Step  2l^ 

Let  D  be  the  V— first  feoal  world  description  ana  a(Z)  the 

action*  Where  F  is  the  list  of  free  variables  in  D  and  Z, 

D  =  (¥  Yb)(E  Xb)d(Xb,Yb,F) 

Gs=  (E  X4^)(V  Y^)g(Xfc',Yg) 

The  general  form  of  the  existential  query  is: 

GH  -^D  =3  ((E  Y  1  )-^ql  (  Y  1  tF)  v 

(E  Y2  )-.q2(  Y2,F)  v 

•  *  *  V 

(  E  YJ  )-^qJ  (  YJ  ,F)  ) 

F*,  Yb*,  and  X^*  are  lists  of  skolero  functions  corresponding  to 
variables  Ff  Yb»  Xg *  Resolve  the  clause  set: 
base  clauses: 

-,d(  Xb,  Yb*  ,  F*  ) 
g(Xg* , Yg) 

Ge 


A  FIRST-ORDEH  FRAMEWORK 


Pa^e  64 


query  clauses! 

ql  (Y1  ,  F*  )  V  ansK  Yl) 

•  •  • 

qJ(VJ,F*)  V  ansJ(YJ) 

SJteji  3_I  Oenerate  Ai  1  Answers 

If  an  empty  answer  arises  then  it  laust  he  the  case  that  GHBf 
and  the  complete  precondition  is  simply  true*  Otlierwise,  form  tlie 
neigati^on  of  the  conjunction  of  all  the  answers  (with  the  same 
assumption  that  only  a  finite  number  will  be  fejenerated)* 

-•  (  (  ans  1  I  (  Tl  1  *  )  V  •••  v  ansi  n  (  1  )  (  T1  n  ( 1  )  )  ) 

A  •  •  •  A 

(  an  sni  l(Tral*)  v  •••  v  ansmn  (m)  (TmnCm)  )  )  ) 
bjtejp  4j^  T  r  ans  form  Answer  Formula 

Replace  each  variant  anshl(Thl* )  by  the  corresponding 
-iphKThl  *  »  F  *  )  and  simplify* 

(p  I  l( Tl I '  , F*  )  A  ..*  A  pln( 1 )  (Tln( 1 )  * ,F*  ) 

V  •  *  •  V 

(  pi.i  l(Tial*»F*)  A  •**  A  pmn  (  m  )  (  Tmn  (  m  )  *  *  F  •  ) 

Let  U  be  the  list  ol  all  variables  in  any  Thl*  ;  replace  the  skolera 

functions  in  each  Thl*  by  the  original  variables  from  Ybt  Xg »  and  F* 

The  weakest  provable  precondition  is  then  the  disjunction  of 
c  on J  unctions, 

(V  Yb  )  ( V  Xg ) ( E  U ) 

((pll(Tll,F)  A  ..*  A  pln(l) (Tln( 1) ,F) ) 

V  •  •  •  V 

(  qm  I  (  Tni  1,F)  a  •••  a  pmn  (in )  (  Tmn  (  m  )  ,  F  )  )  ) 
henceforth  abbreviated  (pll(Tll,F)  av  etc)*  The  precondi t i on ,  like 
the  orignal  goal  state,  is  ¥-first* 
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4.5>3  Examples  Of  Pro^iression  And  Regression 

For  clarity'  of  exposition  of  the  followlni^  examplesy  I 
that  the  answer  ^jenerator  is  sophisticated  enough  not  to 
redundant  answers* 


Disjunctive  Information 


Recall  the  propositional  example  from  [Rosenschein  81] 
uses  the  following  axioms* 


A  3[a]  (BvC) 

G  a  ]  -»B 

(FaE)  3£a3  D 

In  this  case  G(a)  is  simply  the  same  as  Gd* 


Ex  ll  Calculate  AaG/a 

base  clauses 
A 
G 

cjuery  clauses 
-•A  V  ansi 
-*G  V  ans2 
-•r  V  -«E  V  ans3 

answer  clauses 
ansi 
an  s2 

postcondi t ion 

(BvC)  A  -.E  =  C 


Ex  2Z  Calculate  a\(CvD) 

base  clauses 
tC 
-.D 


query  clauses 

B  V  C  V  ansi 
-iB  V  ans2 


assume 

produce 


which 
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D  V  a  ns.} 

answer  clauses 
ansi  V  ans2 
ans  3 

precondi tion 

(A  A  G)  V  (F  A  E) 

We  se«^  how  v  and  a  are  reversed  when  forming  the  precondition* 


^uan t i._f led  ^nf  orraajti_on 


The  next  series  of  examples  come  from  the  delightful  world  of 
electronic  warfare*  Interpret  mx(ClTY)  and  hq(CITY)  as  CITY  Is  the 
location  of  an  mx  missile  silo  and  CITY  is  a  command  headquarters 
respectively*  Bombing  a  city  destroys  any  missile  silo  there,  but 
all  other  silos  are  unaffected* 


Gd 

(  1) 

Vy  ( 

nx  (  y  )  3 

[bomb(y)]  -imx  (  y  }  ) 

(2) 

Vyz. 

(  (  rax  (  z  ) 

A 

yi^z)  =>  [bomb(y)]  mx  (  z  )  ) 

pure 

frame  axioms 

.  • 

(3) 

Vyz, 

(  -^mx  (  z  ) 

Z3 

[bomb(y)  J  -*mx{z)  ) 

(4) 

¥y^. 

(  hq  (  z  ) 

rj 

[bomb ( y ) J  hq ( z ) ) 

(5) 

Vyii 

(  hq  (  z  ) 

r) 

[  b  omb  (  y  )  ]  -»hq  (  z  )  ) 

(6) 

Vyzw 

(  z=  w 

3 

[bomb(y) ]  z=w) 

(7  ) 

Vyzw  (  w 

3 

[  b  omb  (  y  )  ]  Z9^  w  ) 

Ex  3:  Calculate  Ex(mx(x)  a  hq(x)  a  mx  (  W  I  AM  1  )  )  /  bomb  (  aIIAM  I  ) 

The  set  of  formulas  G  ( bomb  ( MIAM I )  J  Is  formed  by  substituting  MIA2«1I 
for  y  in  each  of  the  dynamic  axioms* 

G ( bomb (M I  AMI )  ) 


iax(  MIAMI  ) 

3 

[bomb{ MIAMI ) 

] 

-•nx  (  MI  AM  I  ) 

V 

Z  1 

((rax(z)  A  iMIAMI^z) 

3 

[ bomb( MIAMI ) 

] 

mx ( z ) ) 

V 

z 

(  -tinx  (  z  } 

= 

[ bomb( MIAMI ) 

] 

-•mx  (  z  )  ) 

V 

Z  1 

(  hq  (  z  ) 

3 

[  bomb  (  W  I  AM  I  ) 

J 

hq { z ) ) 

¥ 

Z  1 

(  -'irq  (  z  ) 

3 

£  bomb ( MIAMI ) 

J 

-•hq  (  z  )  ) 

¥ 

z  w  1 

(  z=w 

3 

[  b  omb  (  Ml  AM  I ) 

J 

z=w ) 

¥ 

z  w  ( 

[  Z^w 

3 

[ bomb ( MIAMI ) ] 

z^w ) 
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T»»e  general  form  of  the  query  Is 

I-  ( m  X  (  X )  A  hq  (x)  a  mx(MIAMl))  r> 
inx(  MIAMI  )  V 
Ez(mx(z:)  a  z^MIAMI)  v 
Ez  (  -»iiix  (  z  )  )  V 
Ez ( hq ( z ) )  V 
Ez  (  -ihq  (  z  )  )  V 
Ezw ( z=w )  V 
Ezw  (  zj^w  ) 

Rewrltlnfc.  this  in  clausal  forral 

base  clauses 
mx  (  X  ) 
hq(  X) 
mx (MIAMI ) 

query  clauses 

-imx(MIAMI)  V  ansi 

-imx(z)  V  z=WlAMI  v  ans2(z) 

mx ( z )  V  ans3(z) 

-ihq(z)  V  ans4(z) 
hq ( z )  V  ans5 ( z ) 
zi^  w  V  ans6  (  z  f  »  ) 
z=w  V  ans7(ztw) 


X  is  a  skoieoi  function  replacin^g  the  existentially 

variable  x  in  the  world  description*  The  (pruned) 

c  ont a ins 

answer  clauses 
ans  1 

ans2(X)  v  ans 6 ( X , M I AM I ) 
an  s4 ( X ) 


This  corresponds  to  the  valid  formula 

(Ex(inx(x)  A  hq(x)  a  mx(MIAMI)))  ^ 

Ex (rax (MIAMI)  a 

((mx(x)  A  x^MIAWI)  V  x=MIAMI )  a 
hq ( x )  ) 

which  yields 

postcondi tion 

Ex  ( -»mx  (  M I  AM  I  )  a 

(mx(x)  V  x=MIAMI )  a 
hq  (  X  )  ) 


quantl fled 
answer  set 
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Almost  any  action  can  alter  ejci  s  ten  tlaliy  — quant  i 'f  led  information* 
Before^  we  knew  that  soinethin42  was  both  a  headquarters  and  a  missile 
silo;  ulterwardSf  the  second  condition  may  have  been  invalidated* 
Ttie  postcondition  is  equivalent  to  -»iaj<  ( M  lAM  I  )  a  EA(hq(x))* 

Ex  4;  Calculate  bomb  (  NYC  ) \Vx  ( -»mx  (  x  )  ) 


base  clauses 
mx  (  X ) 

query  clauses 

-uax(NYC)  V  ansi 
mx(z)  V  ans2(z) 

-»mx  (  z  )  V  ans3(z) 
hq ( z )  V  ans4(z) 

-»hq(z)  V  ans5(z) 
z=w  V  ans6(zywi) 
z^w  V  ansTlzfW) 

a  n  s  w  e  1'  clauses 

ansi  V  ans6(XfNYC) 
an  s3 ( X ) 

p  r  e  c  o  n  «.l  i  t  ion 

•Vx  (  (inx  (  NYC  )  A  x  =  NYC)  v  -imx(x)) 


That  is»  ¥x(mx(x)  3  x  =  NYC)»  which  a^grees  with  our  intuitionsi  if  no 
silos  arc  left  after  bombing  NYC,  beforehand  NYC  could  have  been  the 
only  silo* 


Ex  5;  hi  t  (  NYC  ) \Ex  ( -.mx  (  X  )  ) 


base  clauses 

m  X  (  X ) 


query  clauses 

same  as  previous  example 

answer  clauses 
an  s  1 
an  s3 ( X ) 


precond i t ion 


A  FI  FRAME  ^OFK 


}*age  5£? 


Fix  (  nx  (  NYC )  v  -inixCx))  =  true  , 

An  important  part  of  any  i  inplenien  ta  t  ion  will  clearly  be  a 
H  1  in|  •  1  i  f  i  c  ti  t  i  on  aec  Via  n  i  Sin  •  The  cost  ot  repressing 

Ex(iax(NYC  v  -tnixCx))  through  lurther  actions  would  be  many  times  the 
cost  of  siiapLy  regressing  true# 


Mui_t_i^l  e  EfJ\ects 


A  i  ng  1  e  dynamic  axiom  can  represent  an  action  whicli 


an 


arbitrariJy  large  numlier  of  entities#  Coiisider  an  action  which 


bombs  all  cities  where  Vi  eadqua  r  te  r  s  are  located# 


Gd 

(  1) 

Vy 

(  hq  (  y  ) 

[ bomba  1 Ihq  J 

-•mxl  y  )  ) 

t  r  ame 

ax  i  oin  s 

(2) 

Vz 

( ( mx( z ) 

A 

-•Viq(z)  )  3  [bombal  Ihq  ] 

(3) 

¥z 

(  -tinx  (  z  ) 

3 

[ bombal 1 hq ] 

-iinx(  z  )  ) 

(4) 

Vz 

(  Viq  (  z  ) 

3 

[ b  ombtt 1 1 hq ] 

h  q  (  z  )  ) 

(5) 

Vz 

(  -ihq  (  z  ) 

3 

[ bomba  1 1 hq ] 

-•  hq  (  z  )  ) 

(6) 

Vzw 

(  z=w 

3 

[ bomballhq ] 

z=w ) 

(7) 

V  zv 

(  z?«w 

3 

[ bombal 1 hq ] 

z^w ) 

Ex  6l  Calculate  (hq(LA)  a  liq(BUF)  )/boinballhq 


base  clauses 
hq ( LA ) 
hq ( hUF  ) 

query  clauses 

-•Lq(y)  V  ansi  (y) 
-»mx  (  z  )  V  ans2(z) 
mx(z)  V  ans3(z) 
-thq(z)  V  ans4(z) 
hq ( z)  V  ans  5 ( z ) 

iij^w  V  ans6(zt**) 
z=w  V  ans7(ziw) 


ans Her  clauses 
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ansi ( LA) 

ansi ( EUF) 

ans4 ( LA ) 

ans4(BUF) 

ansl(w)  V  ans5(w) 

postcondl tion 

¥w  (-iinx(LA)  A  -inix(BUF)  a 
hq(LA)  A  hq(BUF)  a 
(-ihq(w)  V  -inix(w))) 

The  postcondition  simplifies  to 

Vw  (hq(w)  3  -iirx(w)  )  a  hq(LA)  a  hq(BUF) 

Multiple  Axioms 

A  final  example  demonstrates  the  step  in  which  axioms 
disjunctive  preconditions  or  conjunctive  postconditions 
rewritten  as  sets  of  axioms*  Say  G  contains 
Vxy  (p(x,y)  3  [a]  (q{x)  a  t(y))) 

Rewrite  this  in  G(a)  as 

¥  xl  yl  (p(xlfyl)  =>  £a]  q(xl)) 

¥  x2  y2  (p(x2ty2)  =?  £a]  t(x2)) 

One  may  confirm  that 

a\(q(C)  A  t(D))  =  (E  x2  yl)(p(C,yl)  a  p(x2,D)) 

which  is  a  precondition  weaker  than  the  more  obvious  p(CyD)* 


4*5*4  Correctness  Cf  Progression  And  Regression 

We  demonstrate  the  correctness  of  the  progression 
regression  algorithms  described  in  4*5*1  and  4*5*2* 


with 

are 


and 
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4*5«4«1  Correctness  Of  Progression  — 

We  shoM  that  the  i  inplement  a  tion  of  ••/*•  fs  correctl  that 

OP  D  o  (  a  (i  )  ]  D/a(Z  )  . 

Tht  descriptive  formula  D  can  hecoiae  false  when  conditionals 
are  introduced  in  the  presence  of  multiple  constraints.  Since 
P  false  =>  [a(Z)]  p 
P  false  3  [a(Z)]  -tp 
then  false/a(Z)  3  false. 

Axioms  AJ  and  A4  and  rule  P2  allow  renaniin^g  of  bound  variables 

in  modal  formula,  as  well  as  the  substitution  of  particular  terms 
for  parni.teters  when  Ga  is  formed.  The  correctness  demonstration 
f>roceedE  in  two  stages.  First,  we  sliow  that 
CP  D  3  (L  Xb)(fc  U)  (plK  T1  1  ,F)  va  etc) 

Second  ,  t  iia  t 

GP  (L  Xh)(E  Xfe5)(V  U) ( pi 1 ( T1 1 , F)  va  etc)  3 

[a(Z)J  (F  Xb)(E  Xg)(A»  U  )  (  q  i  I  (  1 1  1  ,  F  )  va  etc) 

Modus  ponens  coiapietes  the  proof. 

Lemma  GP  D  3  (E  Xl»)(F  Xg)(A’  U)(pll(Tll,F)  va  etc) 

We  know  that  the  use  of  tracing  functions  is  a  correct  method 

for  l*;i|.-lent*iitin45  answer  extraction.  Therefore  the  for  mu  i  a  s 
phl(Ttil',F*)  V  ...  v  phn(h)(Thn(h)*,F*) 
are  d  e  du  c  i  b  L  e  f  t  om  the  bases  ciauses  for  1<— b<C  —  m.  By  tbe  deduction 
principle  of  first-order  logic, 

((¥  YbYg)  (d(Xb*  ^  g(^ii'fYg)  A  Ge))  ^ 

(V  U)(phl(Thl*,F*)  V  ...  V  pbn( h ) (Thn (h) • , F* ) ) 


is  a  tai».tolo^y  for  l<-h<  — m. 


Tber  efor e 
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((¥  YbYg) (d(XD» , Yb,F» )  A  fe(XgV,Yg)  a  Ge) )  o 
(¥  U)  (plKTll  •  ,F»  )  VA  etc) 

is  vaiia*  One  can  substitute  a  free  variable  for  a  0-ary  function 
in  a  tautology  and  still  have  a  tautology*  So  the  skolem  functions 
can  be  elinilnatedl 

((¥  YbYg)  (d(Xb,Yb,F)  A  g(Xg,Yg)  a  Ge))  => 

(¥  U)  (plKTll  ,F)  VA  etc) 

Since  this  is  a  valid  formula  of  first-order  logic  expressible  in 

TDLt  TUI  tells  us  that  this  is  a  theorem  of  TDL*  Simple  first-order 

manipulations  further  transform  the  formula* 

t-  ((E  XbXg)(¥  YbYg)  (d(Xb,Yb,F)  a  g  (  Xg ,  Yg )  a  Ge))  =) 

(E  XbXg)(¥  U)  ( plKTll,  F)  VA  etc) 

I-  ((E  Xg)(¥  Yg)g(Xg,Yg)  A  Ge)  3 

(((E  Xb) (¥  Yb)d(Xb, Yb,F) )  3 

(E  XbXg)(¥  U)  (plKTll, F)  VA  etc)) 

that  is 

»-  (Gs  A  Ge)  3  (B  3  (E  XbXg)(¥  U  )  (  p  1 1  (  Tl  1  ,  F )  va  etc)) 

By  TH2, 

GH  D  3  (E  XbXg)(¥  U) (pll (T11,F)  va  etc) 

Lemma  2:  GH  (E  Xb ) ( E  Xg ) ( ¥  U ) ( p 1 1 ( Tl 1 , F )  va  etc)  3 

[a(Z)J  (E  Xb)(E  Xg)(¥  U ) ( q 1 1 ( T 1 1 , F )  va  etc) 

The  second  part  is  also  straightforward*  By  A3  derive  from  Gd 
the  series  of  formulas 

Gl-  plKTll, F)  3  (a(Z)]  qlKTll,F) 

#  •  • 

GH  pmn  (in  )  (Tmn  (  m  )  ,  F  )  3  (a(Z)]  qmn  (  m )  (  Tmn  (  m  )  ,  F ) 

Propositional  manipulations  combine  the  above* 

GK  (plKTll, F)  VA  etc)  3 

(  (  [a(Z)  ]qlKTll,F)  v  ***  v  [  a  (Z  )  ]q  In  (  1 )  (T  In  (  1  )  ,  F )  ) 

A  *  *  *  A 

( £ a(Z) 3qml (Tml ,F)  v  ***  v  [ a ( Z ) ]qmn( m ) ( Tmn ( m ) , F ) ) ) 
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Tll5  and  pei'rnl't  sin:pliticatioa  ol  the  consequence* 

(.1-  (pll(Tll,F)  VA  etc)  3  [  a  (Z)  ]  (ql  1  (T1  1  ,F  )  va  etc) 

Insert  quantifiers  using  DPI  anci  DIJ2* 

GF  ((F  XbXg)(V  U  )  (pll (T1  1,F)  VA  etc))  3 

(F  XbXg)(A^  U)[a(Z)3(qll(TllfF)  va  etc) 

TH4  lets  us  push  the  quantifiers  through  the  action* 

CH  ((t  XbXg)(V  U  )  (pll  (T11,F)  va  etc))  3 

[a(z)]  (E  XbXg)(-V  U)(qll(Tll,F  va  etc) 

The  final  result  is  that  the  calculated  postcondition  does 

I 

Indeed  hold  after  the  action! 

GK  D  3  (a(Z)]  (E  Xb ) ( F  Xg)(E  U ) ( q 1 1 ( i 1 1 , F )  va  etc) 

The  algorittim  is  correct* 

4*5*4*2  Correctness  Cf  Regression  — 

The  steps  are  now 

Gt-  ((V  YbXg)(E  U  )  (ql  I  (Til,  F)  av  etc))  3  D 

and 

Ch-  ((V  Y»>Xg)(E  U  )  (  pi  1  (  T1  1  ,F)  AV  etc))  3 

[a(Z)]  (V  YbXg)(F  U) (ql 1 ( 11 1 ,F)  av  etc) 

From  the  argument  made  earlier  for  the  correctness  of  answer 

extraction  and  the  retcovai  of  skolem  functions, 

»-  (V  Xb)(V  Yg)  (-.d(Xb,Vb,F)  A  £;(Xfc,Yg)  a  Ge)  3 

(V  U)  (  (-.ql  KTll  ,F)  V  *..  V  -.qln(  1  )  (  Tln(  1  )  ,F  )  ) 

A  •  *  *  A 

( -.qia  1  (  Tn  1  ,  F  )  v  ***  v  -.q  ran  (  ir  )  (  Tmn  (  m  )  ,  F  )  )  )  ) 

h  enc  e 

F  ((F  Xg)(¥  Yg)g(Xg,Yg)  A  Ge)  3 
(((E  Yb)(V  Xb)-^d(  Xb,  Yb,F)  ) 

(E  YbXg)(V  U  )  (-.q  1 1  (T1  1  ,F)  va  etc)) 
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»-  (Gs  A  Ge)  3 

(((V  YbXg)  (E  U)(ql  1(111)  Av  etc))  => 

(V  Yb)(E  Xb)cl(Xb,Yb,F)  ) 

So 

GH  ((¥  YbXg)(E  U)  (qll  (Til  ,F)  av  etc))  => 

(V  Yb)(E  Xb)d(Xb,Yfc,F) 

The  sketch  of  the  proof  of  the  second  step  Is  the  same  as  for 
progression*  Modus  ponens  then  gives  correctness  of  regression: 

GH  ((¥  Yb)(¥  Xg)(¥  U) (pll (Til ,F)  av  etc))  ^  [a(Z)]  D 

4*5*5  Termination  Cf  The  Progression/ Regression  Algorithms 

The  answer-generation  process  always  terminates  in  the 
propositional  case  because  only  a  finite  number  of  clauses  can  be 
formed  from  a  finite  set  of  propositions  (0— ary  predicates)* 
Although  resolution  (or  any  other  complete  quest! on— answer ing 
mechanism)  does  not  always  terminate  for  full  first-order  logic*  one 
would  hope  that  the  quantifier-ordering  rules  suffice  to  guarantee 
termi nat i on  * 

Unfortunately*  this  is  not  always  the  case*  Although  the 
number  of  ground  instances  of  all  the  clauses  is  finite*  situations 
arise  in  which  arbitrarily  long  clauses  containing  variables  are 
created*  This  phenomenon  is  a  concern  to  researchers  in  deductive 


quest  ion— answerl ng  on  data  bases* 


Infinite  deductions  are  possible 
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wtieti  ttif  set  of  clauses  contains  [Lewis  75J*I  a  cj^cle 

arises*  lor  exar.iple*  from  the  recursive  axiom 
Vxyz  ((on(x,30  a  above(y,z))  ^  above(x*z)) 

Kven  if  no  cycles  appear  in  ttie  clause  form  of  Gs  a  nci  the  world 

d  esc  r  i  |j  t  i  <'n  D*  cycles  nay  appeal*  when  the  query  clauses  are  added* 


Several  situations  can  arise  in  the  answ er — ^ene ra 1 r o n  portion 
of  the  a  1  i.i>  r  i  t  hm  : 

!•  A  finite  number  of  answers  are  f^enerated  and  the  al^'orithra 
halts* 

2*  Only  a  finite  number  of  answers  need  be  generated*  but  some 
cycle(s)  lead  to  an  infinite  series  of  resolutions* 

3*  All  infinite  number  of  sit^ni  f  lean  tly  different  answers  are 
generated*  The  strongest  provable  postcondition  (weakest  provable 
precondition)  cannot  be  represented  by  a  finite  F,— first  (•¥— first) 
formula* 


*  Formally*  a  cycle  is  a  set  of  clauses  of  the  form 


-^Ll  (  X  1  )  V  L2  •  (X2*  )  V  *  .  * 

-iL2(  X2  )  V  L3*  (X3'  )  v  .  *  * 

-•L3(X3)  V  L4*(X4*)  V  *** 

•  •  • 

-^Ln(Xn)  V  Ll*(Xl')  v  •*. 


where  Li(Xi),  Li*(Xi*)  are  literals,  and  there  is  a  vinifyinfe 
subs  t i t  u  t i on  T  such  t  ha  t  Li(T)=Li*(l)  for  l<  =  i<  =  n* 


[Reiter  78]  discusses  a  number  of  techniques  for  '‘neutralizing'’ 
certain  forms  of  cycles* 
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The  examples  presented  in  this  paper  fall  in  the  first  two 
categories.  In  these  exampleSf  f urthe rmor e f  the  simple  heuristic  of 
subsumpt i on  cuts  all  infinite  deductive  paths  [Chang  73]*  A  clause 
I-  subsumes  a  clause  M  if  a  variant  of  L  Is  contained  In  M«  We 
eliminate  subsumed  clausesy  as  they  are  generated*  from  the  clause 
set*  The  ans  predicates  are  considered  part  of  the  clause  when 
testing  for  subsumption*  E*gl 

p(x)  V  ansl(x)  does  subsume  p(y)  v  ansl(C44) 
p(x)  V  ansl(x)  does  not  subsume  p(Cl) 

The  notion  is  that  a  subsuming  clause  must  not  have  an  ancestor 
derived  from  a  dynamic  axiom*  which  is  lacked  by  the  subsumed 
clause*  For  each  answer  clause  lost  because  one  of  its  ancestors  is 
subsumed*  there  is  an  equivalent  or  stronger  answer  clause  with  the 
subsuming  clause  as  ancestor* 

The  following  planning  problem  demonstrates  the  third  case* 
where  heuristics  are  to  no  avail*  because  the  regression  of  a 
formula  is  not  finitely  realizable*  Let  G  contain  only 
Gs 

Vxyz  ((on(x*y)  a  above(y*z))  above(x*z)) 

Vxy  (on(x*y)  ^  above(x*y)) 

Gd 

Vxy  (on(x*y)  ^  [A]  on(x*y)) 

Try  calculating  A\above ( C * D ) *  The  weakest  computable  precondition 
i  s 

on(C*D)  V 

(E  xl)(on(C*xl)  A  on(xl*D))  v 

(E  xlx2) ( on ( C, xl )  a  on(xl*x2)  a  on(x2*D))  v 

(£  xlx2x3  )  (  on  (  C  *  3(1 )  a  on(xl*x2)  a  on(x2*x3)  a  on(x3*D)) 

V  * • *  forever 
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The  obvlouH  precondition,  above(C,l)),  can*t  be  obtained,  because  we 
have  deliberately  neglected  to  provide  a  frame  axiom  for  above. 

Simply  stopplni^  the  answer  4jeneratlon  process  at  some  pre-set 
time  limit,  or  establishing  a  ien*,  th— li  mi  t  for  clauses,  does  not 
correctness  (but  of  course  risks  the  loss  of  some  solutions)  . 
The  ultimate  solution  may  be  to  revamp  BIGRESS  so  that  it  does  not 
calculate  the  entire  progression  or  regression  of  a  formula  at  once, 
but  only  portions  on  an  "as  needed"  basis.^ 


4.5.6  Efficiency  Of  Re*iression  And  Progression 

We  have  begged  the  question  of  efficiency;  having  left  the 
warm  confines  of  STRIPS,  the  combinatorial  problems  of  frame  axioms 
appear  in  full  force. 

In  particular,  the  interaction  of  the  frame  axioms  for  equality 
and  the  theorem-p  rover  •  s  mechanism  for  handling  equality'  can  cause 
combinatorial  explosion  Intolerable  in  even  the  most  trivial 
implementation.  The  clause  ••x  =  y"  paramodula  t  es  against  an^  other 
clause.  Yet  no  significant  answers  are  lost  if  the  theorem  proven 
only  resolves  this  clause  so  that  at  least  one  of  its  variables 
unifies  with,  a  skolem  function.  Equality  predicates  in  clauses 
should  be  evaluated  whenever  possible,  and  tautologies  removed. 


The  postcondition  is  not  weakened  (precondition  is  not 
s  tr€  ngthcneci )  if  ground  instances  of  invariant  pz'edicates  which 


*  See  [Waidlnger  77]  for  an  argument  for  the  undesirability  of 
calculating-,  at  once,  the  complete  progression  of  a  condition 
til  rough  an  action. 
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appear  as  domain  constraints  axe  disregarded  by  the  theorem  prover* 
The  frame  axioms  for  such  predicates  force  the  resolution  procedure 
to  extract  the  "intensions”  of  certain  answer  sets.  This  means t  in 
particular!  that  not  all  of  Ge  need  be  worked  with. 

For  example*  suppose 
Gs 

vi rus ( GERMl ) 
vi rus ( GERM2 ) 

•  •  • 

vi rus (GERM999S9) 

Gd 

¥y(virus(y)  £  ir  radia  t  e  ]  rautated(y)) 

Vy(virus(y)  [  i  r  radi  a  t  e  ]  vlrus(y)) 

Vy  ( -»vl  rus  (  y )  ^(irradiate]  -»virus(y)) 

Virus  is  invariant.  Using  the  full  set  of  axioms  in  calculating  the 

effect  of  irradiate  on  any  state  gives 

true/ irr  adiat  e  =  ¥y  ( -iv  irus  (  y  )  v  mutated(y)) 

A  rautated(GERMl ) 

A  muta t ed ( GERM2 ) 

A  .  .  . 

A  mutated(GERM99999) 

If  no  axioms  from  Gs  are  used*  one  obtains  the  shorter 
t  rue/ irradiat  e  ==  Vy  ( -ivi  rus  (  y  )  v  mutated(y)) 

These  formulas  are  equivalent  under  G. 

Every  significant  answer  should  have  an  ancestor  in  either  a 
non-frame  dynamic  axiom  or  the  given  world  description. 
Completeness  is  not  weakened*  since  the  only  answers  lost  lead  to 
post/pre  conditions  derivable  from  the  static  axioms  alone.  This 
may  be  the  key  to  a  successful  implementation:  it  helps  keep  keeps 
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■the  1  n  :f  o  f'Riti  1 1  <>  n  Htored  in  tlie  sttitlc  axioms  from  hein^  clupi  i  co.  t  eel  in 
each  world  desc  r  1  t  i  on  • 


The  very  lack  of  a  built-in 
built-in  limitations)  to  the  frame 
approach  makes  it  a  4$ood  framework 
ai^ainst  these  viscous  difficulties* 


solution  (with  cor  resiJonding 
and  equality  problems  in  the  DL 
for  testing  various  solvents 


4.6  DETi KM  IN  1ST IC  CCNTKOL  SlkATEClES 

The  bare-bones  BlGkESS  algorithm  says  little  about  how  actions 
and  tests  are  actually  chosen»  and  at  what  point  oacktracking 
occurs.  To  implement  BIGKESS  on  a  real,  serial  machine,  its 
non-de  te  rmi  n  ist  ic  ’’choice"  operation  must  be  simulated  by  a 
deterir.i  ni  St  i  c  control  strategy.  Such  a  strategy  seeks  to  strike  a 
balance  between  two  goals:  finding  any  possible  solution 

(  complete  ness )  ,  and  finding  a  soivition  quickly  (efficiency). 

As  shown  in  4.3*2,  "non-de termini stic"  BIGKESS*s  completeness 
rests  on  completeness  of  the  progression  and  regression  functions. 
When  the  space  of  state  descriptions  is  finite  (as  in  the 
propositional  case),  a  depth-first  deterministic  strategy  can  be 
complete,  given  completeness  of  the  auxiliary  functions.  Loops  in 
the  search  space  can  be  eliminated  by  extra  checking  in  Liveforward 
and  1- i  veback  ward ,  as  suggested  in  (.  Eosenschei  n  SI]*  Let  BIGRESS 
take  as  parameters  not  only  the  lists  R  and  S  of  the  current  intial 
and  goal  descriptions,  but  descriptions  of  all  previously  visited 
states*  Prune  progressed  descriptions  implied  by  any  old 

description,  or  regressed  descriptions  which  imply  any  old 
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desc  r i pt i on • 

In  the  first-order  casef  the  state  space  can  be  inflnltey  as  in 
the  second  socks  example  (section  5*2) •  Some  form  o±  breadt h— first 
search  is  needed  for  completeness*  For  example:  Effectively 
envuiierate  the  sets  of  atomic  actions  and  non— modal  wffs*  Initialize 
some  global  variable  I  to  1*  Find  all  plans  of  len^^th  less  than  or 
equal  to  I  (i*e*t  I  calls  to  BIGRESS)  containing  no  action  or  test 
numbered  higher  than  I*  Increment  I  and  repeat* 

A  br ead th— f i rs t  bidirectional  search  (alternating  choices  from 
Liveforward  and  Livebackward )  is  suprislngly  efficient  for  fairly 
short  plans  (Nilsson  80]*  Efficiency  is  increased  by  heur ist ically 
ordering  the  sets  generated  by  Liveforward»  Livebackward y  and 
Nontriv*  As  in  STRIPSy  one  could  analyze  the  partial  proof 
constructed  in  a  failed  stopping  test  as  a  basis  for  guessing  a  good 
next  action* 

♦  ♦  ♦ 

In  summary:  we  defined  a  first-order  planning  problemy  and 
extended  the  propositional  provability,  progression,  and  regression 
functions*  Correctness  was  proved,  and  problems  of  completeness 


d i scussed  * 


CHAPTHR  5 


EXAMPLES  OE  PLANNI^O’  IN  TDL 


1  shall  present  a  number  cl  planninfe  problems  which  demonstrate 
the  stren*  ths  of  the  TDL  framework#  Examples  shall  include 
disjunctive  ^oals  and  world  de sc r i p t 1 ons f  derived  predicates, 
actions  with  side  effects,  non d e t er mi n is t i c  actions,  and 
" distributed'*  action  definitions;  all  features  which  are  difficult 
to  ac come date  in  other  systems# 


5#1  bLOCKS  AND  BOXES  WORLD 

That  hoariest  cf  settings,  the  blocks  world,  can  still  provide 
some  challenging  problems#  The  domain  will  contain  a  table  and  a 
nunl>er  of  boxes  and  blocks#  A  block  can  be  supported  by  the  table 
or  one  of  t ne  boxes#  (Blocks  won't  be  stacked  directly  on  other 
blocks#)  Blocks  can  be  cubes,  cones,  and  spheres#  The  static 
axioms  IncJudel 

box(BOXl),  box(BCX2),  box(BCX3) 
bio  ck (BL Ll),  •##,  biock(BLKS) 

Vx  ((box(x)  V  x=IABLE)  =  sup(x)) 

Vxyz  ((on(x,y)  a  on(x,z))  ^  y=z) 

¥xyz  (  ( sh ape (  X , y  )  a  shape(Xfz))  ^  y=z) 


EXAMPLES  GF  PLANNING  IN  TDL 


Pa^e  72 


Domain  constraints  shall  be  added  as  necided  to  illustrate  various 
features*  Assume  that  Gd  includes  appropriate  frame  axioms  for  all 
actions  so  that  box f  blockf  and  shape  are  invariant. 

Suppose  that  a  robot  hand  is  able  to  manipulafe  one  block  at  a 

lime  • 

¥  xy  ((on(x»y)  a  handempty)  ^  [ pickup ( x f y ) ]  hold(x)) 

V  xy  ((hold(x)  a  sup(y))  z)  [  pu  tdown  ( x ,  y  )  ]  (on(xty) 

A  handempty)) 

frame  axioms! 

V  xyzw  (on(ztw)  a  z^x)  =>  [  pickup!  x ,  y )  ]  on(ztw)) 

¥  xyzw  (on(ztMr)  3  [  pu  tdown  (  x  ,  y  )  ]  on(ztw)) 

A  plan  constraint  can  include  an  indefinite  ^oal»  for  instance^  to 

obtain  a  cube  or  a  cone  on  B0X2  from  a  state  where 

shape! BLK3, CUBE) 
shape ! BLK4 , SPHERE ) 
shape !BLK5, CONE) 
on ! BLK3, BOXl ) 
on !BLK4, TABLE) 
on ( BLK5, TABLE) 

is  truet  Gs  should  be  expanded  to  include  the  first  three 

propositions  above*  and  R£S!u)  should  be 

!on!BLK3* BOXl )  a  on ! BLK4 , TABLE )  a 
on ! BLK5 t TABLE )  a  handempty) 

3  [u]  !E  X ) ! on ! x f BOX2 )  a  ! shape ! x * CUBE ) 

V  shape ! X y CONE ))) ) 

Of  course*  BIGRESS  can  return  either 

[  pickup!  I3LK3*  BCXl  )  ;  putdown  !  BLK3*  BCX2  )  ] 
or 

[ pickup! BLKSyTABLE) ; putdown ! BLK5 * BOX2 ) ] 

A  more  interesting  problem  arises  when  less  is  known  about  the  shape 


of  the  blocks. 


Use  the  same  plan  constraint  when  Gs  contains  only 
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shape ( »LK 3 , CUBE )  v  shape ( BLKS , C UBE ) 

A  s  t  r  a  "I  A’ o  rwa  rci  seuech  hy  "the  planner  could  come  up  wilii  the 
solut 1  on 

[pickup(bLKJ»  BOX  1  )  ; put down ( ELK J , BOX  2)  ; 

p  1  ck  up  (  iJL  K5  »  1 A  IJLE  )  ;  pu  t  down  (  BLK5  t  WOX2  )  ] 

Since  one  of  BLK3  or  BLK5  must  be  u.  cube,  putting  both  on  BOX2 

assures  that  at  least  a  cube  is  there*  If  the  p*redicate  shape  can 

be  used  as  a  test,  then  a  more  efficient  solution  can  be  Icund* 

[ shape ( BLK J, CUBE  )  - 

(  pickup  (BLK  3,  BOX  1  )  ;putdown(  BLK3,1jOX2)  )  , 

(picKup(BLK5, TABLE)  ;putdown(BLK5,BCX2)  )  ] 

Note  that  NonTriv  would  never  return  the  test  shape ( BLK4 , cUBE ) , 

becavise  one  can  derive  from  the  axioms  -ishe  pe  (  I3LK4  ,  CUBE )  • 

The  blocks  world  I've  described  so  far  lacks  any  interesting 
interactions  between  successive  actions*  To  liven  things  up  a  bit, 
t  lie  boxes  wi  LI  be  given  lids  which  can  be  opened  or  closed*  Blocks 
can  be  put  in  or  reinoveti  from  a  box  when  the  box  is  open*  When  the 

lid  is  closed,  blocks  can  be  piled  on  top  of  the  box*  Let  Gd 

contain 

V  xy  ((in(x,y)  a  -iclosedCy)  a  handempty) 

[ pickup ( X , y )  ]  hold(x)) 

V  xy  ((on(x,y)  a  handempty  ^ 

[ pickup(x,y) ]  hold(x) ) 

¥  xy  ((hold(x)  A  box  (  y  )  a  -ic  1  o  sed  (  y  )  )  ^ 

[  pu tdown ( X , y )  ]  (in(x,y)  a  handempty)) 

¥  xy  ((Ijold(x)  A  sup{y)  a  cloi3ed(y))  ^ 

[putdown(x,y)]  (on(x,y)  a  handempty ) ) 

¥  X  (  {-iciosed(x)  A  box(x)  )  ^ 

tahut(x)3  closed(x)) 

¥  X  ((<!losed(x)  A  box(x))  ^ 

£open(x)  ]  -"C losed(x)  ) 

Note  th*il  the  effect  of  the  putdown  action  depends  upon  the  state  of 
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world  in  which  it  is  periorined;  i±  the  lid  is  openf  the  bloclc  goes 
into  the  box;  otherwiscf  it  goes  onto  the  box*  Gs  should  include 
c losed ( TABLE ) •  The  frarae  axioms  are  s tr a ight forward »  except  for  the 
open  action*  It  has  the  side  effect  of  dumping  all  the  blocks  which 
were  resting  on  the  lid  onto  the  table*  The  frame  axioms  arel 

V  xwz  ((on(wyz)  A  z^x) 

Copen(x)]  on(wyz)) 

¥  xw  (  (closed!  Jt)  a  box(x)  a  on(wyx))  ^ 

[ open ( X )  ]  on ( w  »  TABLE )  ) 

V  xywz  ({in{wt2:)  a  w?<x)  => 

[ pi ckup ( X ty ) ]  in(wtz)) 

V  xywz  ((on(wyz}  a  w^x)  ^ 

[ pickup ( X yy ) ]  on(wyz)} 

+  pure  frame  axioms  for 
openi  hcldy  in 

shut:  holdy  iny  on 

pickup:  closed 

putdown:  closedy  iny  on 

Open  is  thus  an  influential  actiony  as  discussed  in  chapter  2l  it 
affects  the  truth  values  of  an  arbitrary  number  of  relationships* 

"Non-linear”  planners  such  as  NOAH  create  separate  subplans  to 
achieve  each  conjunct  in  a  conjunctive  goaly  then  heuri s ti cally 
interleave  the  subplans  to  achieve  the  combined  goal*  The  greater 
the  number  of  potential  interactions  between  operators  —  the  more 
ways  in  which  one  action  can  undo  the  effect  of  another  —  the  more 
costly  a  non— linear  approach  to  planning  becomesy  and  the  more 
attractive  a  straightforward  linear  planner  like  BIGKESS*  Consider 
the  problem  specified  by  the  constraint 

(in (BLKl y BOXl )  a  in(BLK2yB0Xl) 

A  closed(BOXl)  a  handempty) 

3  [u]  (on( BLKl yBOXl  )  a  on ( BLK2y BOX 1 )  ) 
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ULKl  nLK2 

o -  o - 

I  11  1 

I  I  to  I  I 

1  liLKl  ULK2  1  I  1 

1  II  I 

I - I  X - 1 

H<^Xt  BOXI 


The  Kliortest  plan  to  cto  this  takes  ei^iht  steps: 

[  open  (  BOX  1  )  ;  pi  ck  up(  BLK  1  ,  BOX  1  )  ;  pu  tel  own  (  BLKl  ,  TABLE  )  ; 
r  i  ckup(  flLK2,  BOX  1  )  ;c  !.ose(  BCXl  )  ;  put  down  (BLK2f  BCXl)  ; 
pi ck  up ( BOX l»TABLE);putdown(BLKl,BOXi)  ] 

A  non-linear  planner  would  create  separate  subplans  to  put  BLKl  and 

BLK2  on  BOX  1 . 

[ open ( BOX  1 )  ; p ickup ( BLK 1 , BOX  1 )  ;c lose ( BOXl )  ; 
pu  tciown  (  BLK  1  »  BOX  1  )  ] 

and 

[  open  (  BOX  I  )  J  p i ckup  ( i3LK2 ,  BOX  1  )  ;c  lose  (  DOXl  )  ; 

I  u t  down ( B  LX  2  f  BOX  1  )  J 

Tliere  is  no  way  to  lineariz.e  these  subplans  to  achieve  tne  desired 
goal*  [Sacerdoti  77]  relers  to  such  a  situation  as  a 

"doubl  e— c  ross'' •  kather  sophisticated  heuristics  (wliich  are  only 
partially  irapleiaented  in  NOAB  )  are  needed  to  insert  new  steps  into 
the  i.'lan  to  temporarily  place  BLkl  on  the  table  while  removing  BLK2* 
bIGKESS,  ol  course,  would  have  to  perloriu  a  great  deal  more  pure 
search  to  1  i  nd  its  soJtition;  but  the  use  of  a  planning  hierarchy 
(see  section  6*2)  can  drastically  reduce  the  search  while  retaining 
1  inear i ty  • 


It  is  often  useful  to  include  axioms  which  essentially  define  a 
new  predicate  in  terms  of  more  basic  predicates*  E'or  instance,  the 
predicate  "at"  could  hold  of  a  block  which  is  either  on  or  in  a  box. 


and  "next  to’*  of  blocks  which  ai’e  on  "the  same  box  I 
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¥  xy  (at(x»y)  =  (on(xf>)  v  inCx^y))) 

V  xy  (nextto(xfy)  =  ((onCxyFOXl)  a  on(y*BOXl))v 

(on(xtB0X2)  A  on(y»B0X2))v 
(on(xfB0X3)  A  on(y,BOX3))) 

Planning  systems  by  [Fahliaan  74]  and  [Fikes  75]  distinguished 
such  derived*  or  secondary  relationships  from  the  more  basic  primary 
relationships#  Their  systems  gained  efficiency  by  not  explicity 
including  rules  for  regressing  or  progressing  secondary 

relationships  through  actions#  The  idea  was  that  the  information 
encoded  by  a  secondary  proposition  in  a  world  description  was  purely 
redundant#  The  planner  would  keep  track  of  the  primary 
relationships  used  in  the  deduction  of  each  secondary  relationship# 
If  any  of  the  former  were  falsified*  the  latter  was  deleted# 

In  the  TDL  framework*  no  special  dynamic  axioms  (including 
frame  axioms)  need  be  included  for  predicates  whose  instances  are 
always  equivalent  to  a  (particular)  formula  not  containing  that 
predicate#  The  planner  need  not  keep  track  of  how  any  predicate  was 
derived;  the  progression  or  reqression  algorithms  effectively 
translate  secondary  relationships  to  a  primary  form  as  needed#  For 
instance*  using  the  axioms  described  so  far*  the  planner  can 
calculate 

at( BLKl* BOXl ) /open (flOXl )  = 

-.closed(  BOX  1  )  a  (  in  (  BLKl  *  BOXl  )  v 

on( BLKl, TABLE) ) 

The  Fahlman  and  Fikes  systems  didn’t  allow  secondary 
relationships  to  explicitly  appear  in  the  problem  description;  such 
relationships  could  never  be  deleted*  since  no  chain  of  deductions 
from  primary  relationships  would  be  known#  But  in  our  purely 
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loiiflcal  1‘ rtiiuework  I  llie  constraint 

1 

(  at(BLKl  ,  130X2)  a  nex  1 1  o  (  BL  K3  ,  B  LK  I )  )  => 

[vi]  -.nextto  (bLK3,  BLKl  ) 

is  |..f*rfectly  acceptable. 

5.2  the:  SOCXS  WOKLE 

A  tire  on  my  automobile  bursts  as  I  speed  down  tlie  New  York 
Tliruway;  tE»e  spare  in  tlie  trunk  is  patched  and  pressurizeot  since  I 


planned 

for 

this  contingency.  Two 

simul t an  eous 

blowouts 

leave 

stranded 

in 

the  deepening  snow.... 

You  pluck  a 

Chris  tmas 

candy 

trom  the  ^aiiy  wrapped  box.  Nougat,  carmel  ,  or  cberrj’  would  satisfy 
your  craving,  but  a  su  Ijjhur— f  i  1  I  ed  center  leaves  you  understandably 
surprised  and  angry. 

Cliance  plays  a  significant  role  in  most  everyday  affairs.  We 
are  al<  1  e  to  create  and  carry  out  plans  because  we  assume 
(Justifiably'  or  not)  that  the  random  nature  of  events  is  constrained 
in  some  known  way. 

In  tlie  typical  blocks-world  scenario,  chance  is  completely 
eliminated.  EZvery  action  modifies  the  world  in  some  known, 

fully-speci  f  i  ed  manner  —  falsilying  some  propositions,  establishing 
otiiers.  Indeed,  only  such  aclions  can  be  represented  by  add/delete 

list  pairs. 

The  TBL  framework  allows  one  to  model  n  t>n~de^ermi  n_i  s  t  i^c 

actions.  Semantically,  a  ncn~de terni nlstic  action  A  relates  some 


worltf  to  more  tlian  one  world  I 


EXAMPLES  OF  PLANNING  IN  TDL 


Page  78 


E  IfJyK  sacn  that  (I^J)  £  M(A)t 

( I  ,  K)  e  M(A)  ,  J  i-  K 

The  postcondition  of  a  non— de termini  Stic  action  and  a  state 
will  generally  include  disjunctive  and  existentially— quanti fied 
information. 

The  famous  "  1  hr  ee— socks  problem*’  incorporates  a  carefully 
controlled  element  of  chance.  You  stand  in  a  totally  dark  room 
before  a  dresser  full  of  loose  socksy  some  black  and  some  white. 
The  only  action  you  can  perform  is  to  pull  a  sock  from  the  dresser 
and  drop  it  on  the  table.  How  many  socks  must  you  remove  before  you 
can  be  sure  that  a  matching  pair  is  laid  out?  In  the  following 
simple  formulation!  the  predicate  was_ontable  holds  of  socks  which 
were  on  the  table  prior  to  the  most  recent  "pick"  action.  The 
proposition  P  states  that  a  black  or  white  sock  is  on  the  table 
which  wasn't  there  before  the  most  recent  action. 

Gs:  P  3  Ex(  on  table  (  X  )  a  -iwas_ontable  (  x  )  a 

(hlackix)  V  white(x))) 

Gd:  true  [pick]  P 

¥y  (  ontabl  e  (  y  )  ^  [pick]  ontable(y)  a  was__  on  table  ( y)  ) 

frame  axioms: 

¥y(whlte(y)  3  [pick]  whlte(y)) 

¥y(black(y)  =>  [pick]  black(y)) 

R(u):  true  [u]  Exy  (ontable(x)  a  ontable(y)  a 

x^y  A 

(((black(x)  A  black(y))  v 
(white(x)  A  white(y)))) 

DIGRESS  quickly  finds  the  solution  pick ; pick ; pick .  A  forward 
search  develops  the  following  sequence  of  state  descriptions. 


FXA\<PLES  or  PLANNING  IN  TDL 


P  a  t;  e  7  £> 


1 rae/ pick  =  P 

! 

(  t  rue/pic  k) /plek  = 

Fx  (onttihle(x)  a  wa  s_^on  tap  1  e  (  x  )  a 
(plack(x)  V  white(x))  a 
P) 

((  truf/pick ) /pic U ) /pick  = 

Ex  X*  {ontaLlo(x)  a  wa s_on table ( x )  a 
(black(x)  V  wliite(x))  a 
x/x  •  A 

untable(x* )  a  wa s_on tabl e ( x * )  a 
(black(x*)  V  white(x*))  a 
P) 

The  final  lorinula  incplies  the  desired  peal#  Note  that  the  planner 
Inters  (  i  ti  the  progression  prop;ress)  that  the  two  socks  tnat  are  on 
the  table  after  the  second  pick  aren't  ec^ual  y  since  was_on  table 
holds  for  one  and  -iwa  s_on  tabl  e  lor  the  other»  and  passes  this 
inequality  through  the  final  pick  action. 


While  tills  problem  may  not  appear  too  Impressive  (no 

i  n  te  1 1 1  t-,en<- e  is  required  in  tlie  seaj'ch - onl3.  one  path  is 

possible) T  it  is  beyond  the  capabilities  of  many  planning  systems. 
Of  the  STk IPS— bused  planners  discussed  here*  only  NOAH  can  be 
programmed  lor  actions  like  "pick  up  a  random  object  from  a  pile". 
But  NOAH's  non— linear  planning  strategy  would  get  it  into  trovible. 
It  would  deal  ttie  disjunctive  goal  "obtain  two  black  OK  two  white 
socks"  I'y  creating  two  suhproblemsy  one  to  obtain  two  black  socks 
and  one  tt>  obtain  two  white  sockSy  with  the  hope  of  later 
incorporating  in  the  final  pi  tin  the  suoproblem  solution  wliich  proved 
easiest  to  obtain.  In  this  casoy  both  attempts  are  bound  to  fail. 


An  odd  feature  of 
sufficed  to  solve 
completeness  of 


the  alcove  set  of  axioms  is  that  altliough  they 
the  problemy  they  do  not  guarantee  the 
fllGKESS's  search.  The  formula 
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( ( ( t rue/ p ick ) / pi ck ) /pick )  implies  that  the  domain  contains  at  least 
three  entities#  The  frame  axioms  for  equality  and  the  “halting 
axiom"  (<pick>true)  allow  one  to  conclude  that 
GH  Exyz  (x^y  a  y^z  a  z/x ) 

— which  can't  be  obtained  from  the  static  axioms  alone*  In  fact» 
such  reasoning  reveals  that  the  domain  must  be  infinite  in  any 
structure  satisfying  the  dynamic  axioms* 

The  problem  is  that  the  socks  are  appearing  out  of  thin  air*  A 
more  elaborate  formulation  makes  sure  that  socks  come  from  the 
dresser* 

Gs:  P  =>  fix  (ontable(x)  a  -iwas_ont  abl  e  (  x  )  a 

was_indresser (x ) ) 

Co:  Vy( indresser (y)  ^  [pick]  P) 

¥y ( ontabl e ( y )  3  [pick]  ( was_on table ( y )  a 

on table ( y ) ) ) 

Vy( indresser (y)  3  [pick]  ( was_indresser ( y )  a 

( indresser ( y )  v 
on table ( y ) ) ) ) 

¥y  (-•  indr  ess  er  ( y  )  =>  ( -i  i  ndresser  ( y  )  a 

-iwas_indresser  (  y  )  )  ) 

The  most  popular  version  of  the  socks  problem  adds  the  fact  that  the 
dresser  initially  contains  exactly  4  (or  any  fixed  number)  black 
socks  and  4  white  socks*  One  formulation  includes  a  domain  closure 
axiom  ♦  for  things  in  the  dresser* 

Add  to  Gs: 

black(3l)y  black(S2)y  black(S3)»  black(S4) 
white(S5)f  white(S6)*  white(S7),  white(S8) 

*  ¥y  (  indresser  (  y  )  =3  (y=Sl  v  **•  v  y=S4)) 
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L(u);  i ndresser ( S 1 )  a  ,,,  a  i n dresser ( S8 ) 

^  [u]  Exy  (ontaJ)ie(x)  a  ontable(y)  a 

x^y  A 

((black (x)  A  black(y))  v 
(wblte(x)  A  v¥hite(y)))) 

Any  number  of  variations  can  be  devised!  ^et  a  pair  of  black  socks 
only  (which  now  has  the  solution 

p  1  ck  ;  pick  ;  p  i  ck ;  i  ck  ;  p  ick  ;  pi  ck  ;  (j  ick  ;  p  ic  k  )  ;  i^et  a  particular  sock! 
allow  multiple  colors*  etc# 

Even  putting  the  domain  closure  axiom  aside*  it  is  no  longer 

derivable  tliat  the  domain  is  infinite.  ••  but  the  search  space  for  a 

particular  iroblem  may  remain  infinite.  Note  that  (without  *) 

true/pick  =>  ElxVy  (-•!  nd  re  sser  (  y  )  v  ontable(x)) 

(  t  r  ue  / i  c  K  ) /p  i  ck  ^  Exx*Vy  (  -»!  ndresser  (  y  }  v 

(  o n tab 1 e ( X )  a 
on  tab i e ( X  *  )  a 
xj^x*  )  ) 

and  so  forth.  Starting  from  a  state  of  complete  ignorance  ( true) * 
applying  pick  N  times  results  in  ttie  knowledge  that  either  the 
dresser  is  empty  (  ¥y  ( -•  i  ndre  ssc  r  (  y  )  )  )  or  N  socks  are  on  the  table. 
I t  is  never  the  case  that 

GH-  true/plck**M  3  true/pickf*N 

for  M<N  *  so  the  simple  heuristics  in  LiveForward  and  LivcBackwaa-c(  to 
detect  loops  will  never  prune  ti^is  branch  of  the  search  tree. 


S.3  DUNGE(.»N::i  WORLD 

A  particular  representation  of  an  action  may  fail  to  capture 
all  relevant  effects  of  that  action  because  the  representation 
i  arik  uage  iacKS  the  necessary  expressive  power.  As  we  have  noted*  it 
X  c;  difficult  or  imposslhle  to  adecjuately  model  a  non—de  termi  n  1  s  ti  c 
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action  if  effects  a 
literals*  Yet  how 
uses  logical  axionSf 
system  designer  may 
the  action*  It  is  d 
easily  st rengthened » 
sense  of  not  working 
r  e  al  world)  were  gen 


re  specified  merely  by  add/delete  lists 
ever  rich  the  basic  framework  is  —  whether 
or  syntactic  operatorSf  or  procedures  — 
simply  be  unaware  of  all  the  relevant  effects 
esirable  that  the  action  representation  can 
and  that  no  '’incorrect”  plans  (incorrect  in 
as  expected  when  actually  carried  out  in 


crated  using  the  weaker  representation* 


of 

one 

the 

of 

be 

the 

the 


Each  TDL  dynamic  axiom  specifies  some 
action*  Additional  axioms  refering  to  the 
as  needed;  indeed*  such  a  modular 
Representing  an  action  by  a  number  of 
perspicuity  of  the  system*  It  appears  ra 
extend  a  planning  system  by,  say,  rewr 
STRIPS*  operators*  Both  approaches  suffer 
per  action"  syndrome* 


partial  effects  of  an 


same 

action 

can  be  added 

st  yl 

e  is 

encouraged* 

short 

axioms 

enhances  the 

ther 

more 

difficult  to 

i  ting 

QLISP 

procedures  or 

from 

the  ” 

one  operator 

More  importantly,  TDL*s  cautious  approach  to  the  frame  problem 
—  insisting  on  explicit  frame  axioms  —  assures  us  that  if 
GH  R  3  [PlanjS 

and  G*  is  a  consistent  extension  of  G,  that 
G»l-  R  =>  [Plan]S 

So  it  is  always  safe  to  use  a  smaller  set  of  rules*  Under  the 
STRIPS  assumption,  redefining  an  action  A  by  lengthening  its 
precondition  or  delete  list  to  Include  a  proposition  B  insures  that 
there  will  be  plans  which  are  solutions  to  problems  using  the  old 
definition  of  A,  but  are  not  solutions  using  the  new  definition* 
For  a  trivial  example,  when 
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olctAt  f>rel 

P 

/ 

de  I  : 

P 

ad d  I 

0 

a  nd 

11  ewA  1  p  r  e  I 

P 

del: 

P,  B 

a  <1  d : 

0 

t  hen  old A  is  a 

plan  to  obtain 

C  A 

B  from  Pa  B,  but 

ne  wA  i 

sn  '  t  * 

Even  if  the 

system  designer 

ini 

tially  suspected  that 

A  maj^  fa 

Isi  f  y 

B*  she  would  not  have  been  Ju 

s  ti  f 

ied  in  using  the  form 

n  e  w  A  in 

the 

f i rs  t  pi  ace ; 

because  newA  is 

a  1  s 

o  a  plan  to  obtain  -»B 

from  P* 

1 1 

is  useful 

to  have 

multi pi e 

axioms  for 

an  action  when 

i  t 

e  f  fee  t 

c  rue  la lly 

depends 

upon  tlie 

state  of  the 

world  in  whicfi  it 

is 

e  xecu  t  ed • 


In 

tiie  gauie 

player 

t  h  I'o  ugh 

walk  is 

a  com pas 

of  the  a 

c  t i on : 

of  Dunfcjeons  and 
a  naze  of  rooirf- 
direction*  ILe 


r agons  * 

t  he 

waj,k 

nd  tunn 

els* 

The 

pl anner 

may 

have 

action  moves  a 
only  parameter  to 
a  partial  itnafe*e 


at(  FOF*fcLT)  r>  [  wa 
at(CAVL)  =>  [  wa 

Discovering^  that  wa 
could  be  accoramod 
axioms  above  are  st 
at (CAVE)  ^  [walk 
the  t^-r  04^r  ession 

a  t (CAVE)  /wal k( NOSTH 
notice  that  the  sec 


Ik(NORTH)]  at(CAV£) 

Ik(NOKTH)]  a t ( BOTTOMLESS_PIT )  v 

at  (TKEASURE_liCON  ) 

Ikins^,  E'OUTH  from  CAVE  takes  you  to  WI  ZAKI)S_L  A I K 
a  t  erl  by  the  addition  of  another  axiom*  If  the 

renfcithened  by  adding  I 
(NORTH)]  at ( rREASUk£_PCOM ) 

algorithm  correctly  computes  that 

)  =  a  t  (  TREASUK£_RCOM )  •  A  ’’smart*'  plannei  might 

end  axiom  becomes  redundant*  but  this  is  not 


necessary  to  insure 


c  o  r  r  ec  t  n  e  s  s 
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HIERARCHICAL  PLANNING 


’’Hierarchical  decomposition”  is  a  buzzword  in  almost  any  area 
of  computer  scienccf  from  pro^^ramming  languages  to  machine  vision* 
The  greatest  appeal  of  the  dynamic  logic  framework  may  be  its 
formalization  of  a  planning  hierarchy. 

As  in  the  propositinal  case>  the  dynamic  axioms  at  one  level 
become  plan  constraints  at  a  lower  level.  But  the  presence  of 
parameterized  actions  make  it  convenient  to  associate  the  tree 
structure  with  a  solved  problem. 


Recall  how  G(a(Z))f  the  Z-instance  of  at  was  formed  by 
gathering  the  dynamic  axioms  for  a  and  applying  specialization  to 
obtain  the  instances  of  the  axioms  with  parameter  list  Z.  Each  node 
of  a  probl era/ so lu tion  tree  is  single— level  planning  problem  and 
solution  pair*  in  the  same  vocabulary.  The  node  has  a  child  for 
each  instance  of  an  action  (i.e.t  each  atomic  action)  which  appears 
In  its  solution.  Where 


<<VOC  ,  G  ,  RES(u(E))>t  B  > 
k  k  k 

is  a  k— level  nodet  then  for  each  atomic  action  a(Z)  which  appears  in 
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Ok  y 


f 


«VOC  ,  G  ,  G  (a(Z))>,  h  > 

K+1  k+1  k  k+1 

Ik  a  child.  The  vocabulary  (way  the  world  is  described)  may 
from  level  1o  level* 


c  hanti  e 


The  treo  may  be  constructed  top-down!  determine  the  top— node 
probleni  and  solution!  foi'm  a  level  2  planning  problem  for  each 
atoc.lc  action  which  appears  in  the  top-level  solution!  from  each 
level  2  problem  and  solution  create  a  child  node!  and  continue  on 
down  the  trt'e*  So  y  if  0  =  a(C)  !a(D)  y  then  two  level  two  planning; 
problems  are  proposed!  one  with  constraint  G  (a(C))y  the  other 
G  (a (  D)  )  . 


A 1 1  e  riia  t  i  ve  1  y  y  it  may  be  possible  to  precompute  parts  of  the 
tree*  TP.e  orife^inal  dynamic  axioms  for  ay  instead  of  a  set  of  their 

instancesy  may  simply  be  taken  as  plan  constraints*  The  result  is  a 
iiene  ra  li  Lower-level  plan  to  perform  the  action!  plans  to 

perform  instances  of  the  actioi.  are  produced  by  a  simple  syntactic 

transformation  of  the  t;eneral  solution*  This  is  made  precise  by  the 
foil owin^ 

Theorem  I  Suppose  <VOCy  Gy  G*(a(Z))>  has  so lution  B* 

Then  lor  any  xly***yxj  e  VAR  and  tly***ytj  e  TERMS 
<VOCy  Gy  C* (  a(Z(tl/xly  •**,  t J / X J ) )  )> 

itas  solution  8(tl/xly  ***y  tj/xj)* 

Eroof  !  Induction  on  B  and  Jy  repeatedly  applying;  A3* 

Two  exai.ipies  follow  y  demon  s  1 1' a  t  i  nfe  both  apprcaclies*  The 

overall  spi^u^_ion  to  a  h  i  e  ra  r  cl;  i  c  al  planning  problem  is  obtain  from 
the  tree  b^  replacinii  each  atomic  action  a(Z)  in  B  by  the  plan  B 
in  the  t:hild  with  constraint  G  (u(Z))  in  bottom— up  order  *  Tl»e  new 

(>laii  at  the  root  solves  the  liipli— level  problem  in  tlie  lowest  — level 
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vocabulary* 


6.1  DUNGEONS  WORLD,  CONTINUED 

This  example  demonstrates  a  trl— level  decoacposi  ti  on  of  the 

dungeons  world  mentioned  in  5.3.  The  top  level  reveals  rooms  which 

contain  objects,  and  includes  an  action  for  transfering  objects  from 
room  to  room.  The  second  level  introduces  a  robot  which  actually 

moves  the  objects  about.  Level  3  breaks  the  robot*s  motion  down 

into  unit  steps.  The  link  between  levels  1  and  2  can  be  entirely 
precomputed,  but  that  from  2  to  3  is  better  computed  as  needed. 

Define  the  top  level  vocabulary  and  domain  constraints  as 

follows . 

Level  1. 

VOCl 

CONI:  SWORD,  GOLD,  ...,  JEWELS 

HOME,  CAVE,  ...,  LAIR 

PREDl  :  Hoc,  room 

ACTl:  transfer 

Gsl  : 

room(HOME),  ...,  room(LAlR) 

Gdl  : 

¥  tobj  tstrt  tfin  ( ( 1 loc ( t ob J , ts tr t )  a  room(tfin)) 

3  [ transfer ( tobJ ,  tstrt,  tfin)]  11 oc ( tob J , tf in ) ) 

frame  axiom: 

¥  tobj  tstrt  tfin  tfobj  tfrm 

(  ( 1  loc  (  t  f  ob  J  ,  tf  rm  )  a  tfobji^tobj) 

3  [ transfer ( tobj ,  tstrt,  tfin)]  lloc(tfobJ,  tfrm)) 

The  predicate  Hoc  holds  of  an  object  and  the  room  in  which  it  is 

located.  The  planning  problem 

<V0C1,  Gl,  KESl(u)  = 

C  (loc (GOLD, CAVE)  a  loc ( JEWELS , LA I R ) ) 
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Paye  t>l 


3  [uj  (  loc(COLD,HOJ*Jh)  A  loc(  Jt\^ELS,HCJilE)  )  )  > 

Jh  Holvcd  by  ( t r a ns ier ( GCLD , CAVE , HOM E ); transf er ( JEWELS , LA 1 K , HOME )] . 
0.1’  Course,  such  a  plan  is  easit'r  syntbesiiied  than  executed  — 
someone  must  out  and  letch  tlie  valuables* 

Level  2  introduces  a  robot  who  can  be  "at"  various  locations* 
The  "mo"  action  moves  him  Irom  room  to  rooir,  Droving  as  well  any 
objects  l.c  is  carryint^*  Grab  and  drop,  as  their  names  su^M^st, 
Initiate  and  terminate  the  carrying  of  an  object. 

The  "basic"  level  2  vocabulary  and  axioms  are: 

Level  2 
VOC2 

CON 2:  HOME 

PKED2:  carry,  at,  loc,  room 

ACT3:  Mrab,  drop,  go 

Gs2: 

V  X  y  ((carry(x)  a  at(y))  =5  loc(x,y)) 

¥  X  y  z  ((loc(x,y)  a  1oc(x,z))  =>  y=z ) 

Gd2: 

no  I  main  axiom 

V  strt  fin  ((at(strt)  a  rooiii(fin)) 

3  [Mo(strt,£in)]  at(fin)) 

no  I  irame  axioms 

¥  strt  fin  gfobj  ^i.rm  (  (  loc  (  gfob  J,  gf  rm)  a  -.car  ry  (  fef  ob  J  )  ) 

3  [ 30 ( s tr t , f in ) ]  1 oc ( gf ob J , fe £ rra ) ) 

¥  strt  fin  gfobj  ( car ry ( g f ob J ) 

3  [ go ( s tr t , £ i n ) ]  carry ( gfobj ) ) 

¥  strt  fin  gfcbj  (-«ca  rry  (gfobj ) 

[  go  (  s  tr  t ,  £  i  n  )  ]  -.carry  (  gfobj  )  ) 

grab,  drop:  main  axioms 

¥  obj  rm  ((at(i*a))  a  loc(obJ,rm}) 

3  [ grab ( ob J )  ]  c  a  r  ry ( ob  J ) ) 


¥  obJ  (carryjobj) 
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3  [dtrop(obj)  ]  -»carry(obJ)  ) 
graby  drop:  frame  axioms 

¥  obj  fobj  ({ -scarry  ( -fob  J  )  a  fobj^obj) 

=>  [grab(obj)]  -icarry  (  f  obJ  )  ) 

¥  obJ  fobJ  ({ carry ( fob J )  a  fobj^obj) 

3  [drop(boj)]  carry(fobj)) 

A  pure  frame  axioms: 

grab:  carryy  locy  at 

drop:  -icarryy  loc  >  at 

The  level  2  actions  are  used  to  solve  the  level  1  domain 
constraints.  But  to  synthesize  a  plan  to  direct  the  robot  anywherey 
his  initial  location  must  be  l«nown  — —  information  which  does  not 
explicitly  appear  in  the  high-level  description.  One  way  around 
this  is  to  simply  insist  that  the  robot  is  at  some  particular  known 
location  —  for  Instancey  HOi^E  — —  in  every  state  in  the  high-level 
plan.  This  is  (a  bit  underhandedly )  assured  by  translating  the 
”lloc(xyy)''  predicate  which  appears  in  the  pre  and  post  condition  of 
every  level  1  dynamic  axiom  as  ''x  is  in  room  yy  and  the  robot  is  at 
HOME".  So  Gs2  is  augmented  by 

¥  x  (lloc(x)  =  (at(HOME)  a  loc(x))) 

The  planner  has  the  choice  of  precomputing  a  level  2  solution 
to  the  constraint  set  Gl ( transfer ( tobjy tstrt y t fin )) y  or  merely 
solving  the  individual  instances  of  transfer  as  they  arise.  The 
former  course  is  preferable  here.  The  level  2  planning  problem 
<VOC2y  G2y  Gl ( transfer ( tobj y tstr ty tf in )) > 
contains  two  plan  constraints;  the  initial  call  to  BIGRESS  is 

BIGRESS(  <  11 oc ( tobJ y tstrt )  a  room(tfin)  y 
Hoc  (  tf  ob  J  y  tf  rm  )  a  tfobj^tobj  >y 

<  Hoc  (  tobjy  tf  in)  y 

Hoc  (  t  f  ob  J  y  tf  rm  )  >  ) 
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rl 


r2 


initi al 


1 loc ( t obj , tstrt )  A 
room ( t f i n ) 

=  1  oc  (  tob  J  , -tstr  t )  A 

at (HOME)  A 
rooiii  (  tf  i  n  ) 


11 oc ( tf ob J f tf rm)  a 
1 1 ob tob J 

=  loc ( t f ob J t tf rm )  < 

at(HCME)  A 
tf obj^tobj 


/go( HOME » tst rt )  1 oc ( tob J t tstr t )  a 

a  t ( tst r t ) 


at ( tst rt )  A 
(( carry ( tfobj )  a 
tfria=HOME  ) 

V  loc ( tfobj f tfrm) ) 


/grab ( tobj ) 


loc ( tob J , tstr t )  A 
at(tstrt)  A  carry(tobj) 


II 


/go ( ts tr t » tf in )  at(tlin)  a  carry(tobj) 


at ( tf in)  A 
(( carry ( tfobj )  a 
tfria=HCME  ) 

V  loc ( tfobj » tfrm) ) 


/drop ( tobJ ) 


/ go ( t  f in  »  HOME ) 


at(tfin)  A  -icar  ry  (  tob  J  )  a 
loc ( tobj , tf i n ) 

at (HOME)  A 
-•c  arry  (  tob  J  )  a 
1 oc ( tobj  f  t f i n ) 


II 


at (HOME)  A 
(( carry ( tfobj)  a 
tf rm=HOME) 

V  loc ( t f ob J » t frm ) ) 


=  1 loc ( tob J , tf 1 n ) 


=  Hoc  ( tfobj  f  tfrm) 


Correctness  of  BIGRESS  lets  us  conclude  that 

G2  I-  V  tobj  tstrt  tfin  (  (  Hoc  ( tob  J  »  ts  t  r  t )  a  rooni(tlin)) 

=>  £  go  (  HOMEt  tstrt )  ;  grab  (  tobj  );go(tstrt,tfin)  ; 
drop (tobj) ;go( tfin, HOME) ] 

11 oc ( tobj  y  tf in )  ) 

G2  •-  V  tobj  tstrt  tfin  tfobj  tfrm 

((  Hoc  ( tfobj,  tfrm)  a  tfobj^tobj) 

3  [ go ( HOME , tstr  t )  ; grab( tobj ) ;go( tstrt, tfin)  ; 
drop  (tobj)  ;go( tfin, HOME)  ] 

Hoc  (  tfobj, tfrm)  ) 

Specialization  (as  in  the  theorem  stated  earlier)  gives  low  level 
plans  to  perform  the  particular  go  atomic  actions  ( go ( HOME , CAVE ) , 


etc*)  needed  in  the  top-level  plan* 
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Gi-ab  and  Drop  are  simply  atomic  actions  at  the  third  ievel  as 

well,  hut  yo  is  replaced  by  tne  walk  actiotif  which  takes  a  compass 

direction  as  its  single  parameter#  Thusy 

Level  3 
Vt)C3 

CON3:  HOME,  CAVE,  lAlk 

N ,  E ,  S ,  W 

PKl.  D3:  loc  ,  at,  carry 

ACTO:  walk,  grab  drop 

Gs3l  t-aiae  as  Gs2 


Gd3: 

^rab,  drop:  same  as  Gd2 
walk:  frame  axioms 

•V  dir  fobj  fra  (  (  1  oc  {  f  ob  J  ,  f  rm  )  a  -icar  ry  (  1  ob  J  )  ) 
wa Ik(dir)]  1 oc ( f obj , f rm ) ) 

V  dir  fobJ  (carry! lobj) 

wa  lk(  dii')  J  carry(lobj)  ) 

V  dir  fobj  (-» carry  (  fob  J  ) 

walk(  dir  )  ]  -icarry  (  f  obj  )  ) 

walk:  i.ialn  axioas 

at(HOly.E)  r5[walk(N)j  at(CAVE) 
atiCAVE)  3[walk(S)J  at(HCME) 
at(CAVE)  3[walk(E)]  a t ( LA  1 k ) 
at(LAIR)  3(walk(W)]  at(CAVH) 


It  is  no  t 
1 eve  1 ; 

1  oca  t  i  on  s 
branc  h  es , 


Very  feasible  to  precompote  the  solutions  to  go  at  this 
since  u  different  plan  is  required  to  go  between  any  two 
,  a  general  solution  would  contain  2N**2 


where  N  Is  the  liumber  of  rooms# 


The  planning  problem  <VCC3,  G3 ,  G2 ( go ( HOME , CAVE )) >  has  ^our 
constraints  —  one  for  the  main  go  axiom,  plus  each  frame  axiom# 
Some  of  the  level  3  solutions: 
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go(HOME,CAVE)  walk(N) 

go ( HOME, HOME)  null 

go ( HOME, LA  IE )  walk ( N ); walk ( E ) 

Tt)us  the  overall  lou— level  solution  to  the  example  planning  problem 

i  s 

walk(N);  grab(GOLD);  walk(S);  drop(GOLD);  walk(N); 
walk(E);  grab(  JE\«ELS)  ;  walk(W);  walkCii);  drop  (  J  EWELS  ) 

The  hierarchy  has  considerably  reduced  the  low-level  search 

space,  but  at  the  cost  ol  efficiency  in  the  overall  plan*  Note  that 
the  low— level  axioma  t  ization  allows  the  robot  to  carrj'  more  than  one 
object*  A  better  solution  would  be  to  walk  to  the  CAVE,  grab  the 
GOLD,  proceed  directly  to  the  LAIR,  and  return  HOME*  Alas,  this  is 
one  of  the  classic  tradeoffs:  search  efficiency  versus  optimality 

of  the  solution* 


6*2  MORE  BLOCKS  AND  BOXES 

What  is  a  *'good”  high  level  view  of  the  block  and  boxes  world, 
described  in  section  5*1?  Recall  that  the  world  had  three  boxes,  a 
table,  and  a  number  of  blocks  which  could  rest  on  a  box  or  the 
table,  or  in  a  box* 


SI 


S3 


S5 


o -  o - 

I  I  I  I 

I  S2  I  I  S4  I 


o - ~  — 

I  I 

I  S6  I  S7 


There  are  seven  sur  faces  on  which  a  block  can  rest,  labeled  SI— S7 
above*  Any  planning  problem  will  probably  involve  simply 
rearranging  the  blocks  on  these  surfaces*  The  high  level  world 
description  contains  a  single  action  move ( obj , olds , news ) ,  to  move  a 
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block  front  oao  surface  to  anotlier./ 

Next,  we  must  decide  what  side  effects,  if  any,  move  has. 
Taking  a  block  o  1. 1  of  a  box  (  f  roiu  S2,  S4 ,  S6)  disturbs  any  blocks 

resting  «*»  the  box  (on  91  ,  S3,  S5 )  •  "Hiding*”  this  fact  from  the  top 

level  view  would  either  lead  to  a  "heuristic",  rather  than  an  exact, 
hierarch3'  of  levels,  ^r  require  that  the  low  level  plan  which 
implements  move  exrUcitly  undo  tlie  side  — e  f  f  ects  •  While  the  latter 
course  may  be  attractive  in  some  cases,  more  efficient  hij^h-level 
plans  (at  the  cost  of  some  extra  effort  in  calcuiatint,  the 
regressions  and  progressions  throut;li  move)  are  obtained  by 
percolating,  the  side  effects  all  the  way  to  the  top. 

SuifacciS  1,3,5  are  marked  us  "above"  surfaces  2,4,6.  The  frame 
axioms  for  move  checK  whiethcr  eacli  block  not  being  explicitly  moved 
is  above  either  the  source  or  destination  surfaces. 

VOCl  ;  HL  K I ,  .  .  .  f  BLK 1 0 

1>1,  ...,  92 

PKHDl I  surface,  above,  ons 
Gsl  : 

V  X  (surface(x)  =  (x=Sl  v  ...  v  x=97)) 

V  X  y  (above(x,y)  =  ( 

(x=Sl  A  y=92)  V  ...  V  (x=SS  a  y=S6))) 

V  X  3  (ons(x,>)  ^  surface(y)) 

Cdl  : 

V  obj  olds  news  ( ( ons ( ob J , ol ds )  a  sur f ac e ( news ) ) 

move (obj,olds,n  ew  s )  ]  ons (ohJ,news)  ) 

¥  obJ  olds  news  w  x. 

(  (  o  w  f  z.  )  A  w^ohj  A  -labo  V  e(.z:»olds)  a  -•above(z.,news)) 

~j(  move  (obj,  olds,  news  )  ]  ons  ( V  ,  z  )  ) 

¥  obj  olds  news  w  z 

((ons(w,z)  A  (  above  (  z  ,  c  1  d  s  )  v  above  (  z ,  news  ))  ) 
i>(  move  (  oL  J  ,  ol  ds  ,  n  ews  )  )  ons  (  ob  J  ,  S7  )  ) 
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Given  these  axiccsi  the  problem  discussed  in  5*1  to  move  two 

blocks  from  inside  BOXl  to  its  top  uses  the  constraint 

(ons( BLKl , S2)  a  ons ( BLK2 , S2 ) ) 

3[u]  (ons(BLKl ,S1 )  a  ons ( BLK2 , S 1 ) ) 

Backwards  search  by  BIGRESS  finds  a  solutiont  probably  without  any 

backtracking*  Li veBackward (  ons(BLKltSl)  a  ons(BLK2»Sl)  )  will  not 

contain  move ( BLKl ^ S2 t SI )  or  move ( BLK2 f S2 t S 1 ) ;  because  of  the 

constraints  on  the  frame  axioms^  the  regression  of 

ons(BLKltSl)  a  ons(ELK2«Sl)  through  either  action  is  falsey  and  thus 

pruned*  So  BIGRESS  must  choose  a  different  spot  from  which  to 

obtain  a  block;  ra ove ( BLK 1 y S7 » S 1 )  will  do*  The  regressed  goal 

becomes  ons(BLKlyS7)  a  ons ( BLK2 y Si ) *  Nexty  the  choice  of 

move ( BLKl y S 1 y S7 )  is  pruned;  the  only  reasonable  choice  is 

move ( BLK2 y S2 y Si )  followed  (finally)  by  move ( BK 1 y S2 y S7 ) *  So  the  high 

level  solution  is 

move(BLKly  S2y  S7) ; 
move(BLK2y  S2y  SI )  ; 
move(BLKly S7y SI) 

The  low  level  vocabulary  and  axioms  are  given  in  5*ly  augmented 

by  translation  axiocs 

V  X  (ons(xySl)  =  (on(xyBOXl)  a  handempty)) 

¥  X  (ons(xyS2)  =  (In(xyBCXl)  a  handempty)) 

¥  X  (ons(xyS3)  =  (on(xyB0X2)  a  handempty)) 

¥  X  (ons(xyS4)  =  (in(xyBCX2)  a  handempty)) 

¥  X  (ons(xyS5)  =  (on(xyBCX3)  a  handempty)) 

¥  X  (ons(xyS6)  =  (in(xyBOX3)  a  handempty)) 

¥  X  (ons(xyS7)  =  (on(xyTABLE)  a  handempty)) 

The  ’’closed*’  predicate  does  not  appear  in  the  high-level  vocabulary 

or  in  the  translation  axioms;  the  solutions  to  move  use  a  test  to 

determine  this  detail*  The  results  of  the  low  level  planning  are 
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*  level  i  itijI em en  t eci  by 

Hiove  (  bLK  ltS2yS7)  (closedi  13GX  1)  -•  opeii(BOXl)»nuil)I 

pickupC  BLKl ,EOXl )  ;  putdown (BLKl , lALLE) 

niOve(BLK2fo2TSl)  (closed(  BOX  1)  -*  open(  BOX  1)  tnull)  ; 

plckup( DLK2, BOXl ) ;  clo8e(B0Xl); 
putdown  (  BLK. 2  , BOX  1  ) 

niove(  LLKl  ,S7,  SI  )  (  closed  (  BOXl  )  -  nul  1  ,  shu  t  (  BOX  1 )  )  ; 

plckup( BLKl , S7 ) ;  putdown (BLKl , SI ) 

The  final  solution  is  Just,  o±  course,  the  conca tentat ion  of  tt»e 
three  plans  above*  The  second  and  tiiird  test  of  ciosed(BOXl)  are 
not  necessary  (they  always  fail)*  Perhaps  a  post— processing  stage 
could  optii.ilze  the  plan  by  reiaovinp  unneeded  tests* 
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"buggy”  hlplj  level  plan  [  move  (  BLK  1  ,  S2  ,  S  1  )  ;  move  (  BLK  2  ,  S2  ,  Si  )  J*  While 
the  cost  of  repairing  this  particular  plan  may  be  cheap,  it  is 
interestinp  to  note  that  retention  of  the  side— effect  in  the  exact 
decompostion  actually  helped  constrain  the  high-level  search* 


#S*3  SUMlwAKY 

A  hierarchical  decomposi  lion  of  a  planning  problem  can  greatly 
increase  search  efficiency*  Imposing  a  hierarchy  involves  not  only 
decisions  as  to  the  tools  available  at  each  level,  but  also  which 
subprobl ems  should  be  (can  be)  solved  in  advance*  The  use  of  plan 
parameters  permits  the  synthesis  of  general  solutions  to  planning 
p  robl ems  * 
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degrades  search  eificiency.  (Of  courscf  even  an  exact  hierarchy 
rarely  retains  all  the  detail  that  a  MACROP  does*) 

The  strict  hierarchy  effectively  isolates  each  sister  nodef 
eliminating  the  need  to  check  for  bad  interactions*  But  it  may  be 
very  desirable  to  allow  some  "communication**  between  sisters*  For 
exarapley  when  solving  the  second  subproblem  in  the  last  example  y  the 
planner  should  have  known  that  BOX  1  was  left  open  at  the  end  of  the 
first  subtask*  In  other  words y  an  ordered  tree  may  be  easier  to 
solve  than  an  unordered  tree*  The  exact  formal  mechanism  for 
carrying  information  from  one  sister  to  the  next  remains  to  be 


defined* 


CHAPTER  7 


FOEHAL  OBJECTS 


7.1  BACKGROUND 

The  amount  of  search  performed  by  a  problem  solver  can  often  be 
drastically  reduced  by  neurl s tical ly  ordering  the  successors  to  each 
node  in  the  search  graph.  But  it  may  be  difficult  to  discern  the 
"best"  successor  until  later  in  the  planning  process!  or  a  number 
of  successors  may  lead  to  essentially  the  same  solution  or  dead-end. 
In  such  circumstances  it  is  advantageous  to  apply  a  partially 
specified  operator  to  the  current  nodet  only  completing  the 
specification  at  a  later  point  in  the  search.  This  effectively 
^  number  of  descendent  brancheSf  while  retaining  the  option 
of  splitting  off  branches  as  necessary. 

Formal  objects  are  used  in  one  version  of  this  technique 
[ Sussman  73].  A  formal  object  is  a  "dummy"  term  introduced  by  the 
planner!  initiallyi  at  leastf  the  formal  object's  referent  is  only 
partially  specified.  A  simple  action  containing  a  formal  object  as 
a  parameter  can  thus  stand  for  a  range  of  constant— parame ter 


act! ons. 
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Mechanisms  for  manipulating  formal  objects^  or  '•uninstantiated 
parameters"!  have  appeared  in  a  number  of  linear  and  non—llnear 
planning  systemst  including  ABSTRIPS  and  NOAH.  Vie  give  a  high-level 
description  of  the  use  of  formal  objects  in  the  TDL  framework.  This 
work  is  valuable  in  providing  a  very  general  basis  for  the  use  of 
formal  objects  in  both  forward  and  backward  searchf  and  at  least  a 
semi— formal  treatment  of  the  correctness  of  plans  containing  formal 
objects. 


7.2  BIGRESS  WITH  FORMAL  OBJECTS 

The  formal  objects  A1 IF o rmOb J s  are  a  distinct  subset  of  the 
vari ables . 


A  restrict i on  wf f  is  a  quan t if 1 er- fr ee  non— modal  formula 
containing  only  i n vari an t  pr ed icat  es • 

Rwf f s ( F ) t  where  F  is  a  list  of  variables*  is  the  set  of 
restriction  wffs  whose  free  variables  are  contained  in  (F  u  H).  (H* 
we  recall*  is  the  list  of  plan  parameters.) 

BIGRESS  takes  as  parameters: 

BIGRESS(R*  S*  FormObJs*  Restrict) 
where  FormObJs  c  AllFormObJs 

Restrict  e  Rwf fs ( FormObJs ) 

and  returns  a  triple 

<Plan*  PlanFormCbJs *  PlanRes trie t> 
such  t  ha  t : 

(i)  Mu  PI  anFor  irOb  Js  contains  all  variables  free  in  Plan 
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(il)  FormObJs  c  P  lanForraCbJs  <=  AllForniObJs 

(ill)  GH  PlanRestrict  r>  (  rl  ^  [Plan]  si) 
for  l<=l<=k 

(Iv)  GF  PlanRestrict  :34  Restrict 

A 

(v)  GF  (L  P  lanFornOb Js )  PlanRestrict 
and  treating  this  test  as  a 
an  answer  exists  in  which  each  variable 
in  PlanFormOb Js  is  bound  to  a  single 
constant^  plan  parajnetert  or  V— quantified 
variable*  This  condition  shall  be 
abbreviated  as  •'F’«‘*'* 


Thus  i’ 1  anPe  s  t  r  i  c  t  specifies  the  sets  of  bindings  for  the  formal 
ob Je  ts  wliich  make  the  Plan  a  solution  to  the  planning  problem* 
Condition  (v)  insures  that  the  planner  knows  of  at  least  one 
suitable  set  of  bindings* 

:=  B1GRESS(R,S, 


SOLVE ( R, S) 


(J  f  true ) 
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BIGKESSCRy  S»  ForraObJSf  Restrict)  : 

If  GH  ri3si  for  l<=i<=k  then 

return  <null,  ForoiObJSt  Restrict>* 


Choose  <A,  R/ A>  from  Li  veForvvard  (  R  »  FormOb  js  )  J 

<Subplanf  RewFormOb J s f  NewRestrict>  := 

BIGRESS(R/Af  S*  ForojObJSf  Restrict); 

return  <A;Subplan»  NewFormOb J s ,  NewRestric t >• 

Choose  <A»  R\A>  from  Li  veliackwar  d  (  S ,  FormCbJs)  ; 

<Subplanf  NewFormOb Js ,  NewRestrict>  := 

BIGRESS(R,  A\S,  FormObJs,  Restrict); 

return  <Subplan;Af  NewFormObJs,  NewRestric t>« 

Choose  <NewFormOb Js t  NewRestrict>  from 

Merge ( FormCbJs ) ; 

return  BIGEE3S(R  a  NewRestrictt  S* 

FormObJs  u  NewFormOb Js  y 
Restrict  a  NewRes trict ) • 

Choose  NewRestrict  from  Di verge ( FormObJs y  Restrict); 

return  BIGRESS(R  a  NewRestricty 

S  A  NewRestricty 
FormObJsy  NewRestrict) • 

Choose  TEST  from  NonTrlv(Ry  FormObJs); 

<Subly  NewForraly  NewResl>:= 

BIGRESS(R  A  TESTy  Sy  FormObJsy  Restrict); 

<Sub2y  NewForm2y  NewRes2>;= 

BIGRESS(R  A  -iTEST  a  NewResly  Sy  NewForml  y  NewResl); 

return  <(TEST  -*  Subly  Sub2)y  NewForm2y  NewRes2)  • 
end  BIGRESS 


LiveForwardy  LiveBackward y  NonTrivt 

Same  as  beforey  except  that  members  of 
FormObJs  may  appear  free  in  A  or  W* 
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M  rfc; e  (  For  ni<)l>  J  s  )  : 

1‘etvirn  [<.NewF'ortnCb,js  f  NewRestrlct>  j 

Now'ForniOb  J  3  c  A  i  IF'ortnCb  Js  —  ForiaCbJs 
Nt'V'K’efc;  tr  Ic  t  e  Rwf  Is  (  NewFornOb  Js  u  FornObJs) 

(E  NewFoi'raCoJs  )  New k t*s  t r  ic  t  )  • 

Dive  rj^e  (  1  orirOb  Js  y  Restrict)  : 

return  (NewRestrlct  | 

NeMPestrict  e  Rw_fts(Forra  Ob  J  s  ) 

GF  NewRestrlct  ^  Restrict 
not  GF  Restrict  3  NewRestrict 
CF*  (E  FormObJs)  NewRestrlct 
(not  CF  -^(Restrict  a  si)) 
lor  1 <= 1 <=  k ) 

Merf.e  introduces  new  Xornml  objects*  It  selects  an  Rwlf 

NewRestrlct  whicti  constrains  ttie  values  of  the  new  objects  only* 

These  formal  objects  are  then  available  to  Li  veF'orwardy 

L i veb ack w ai d y  or  NonTriv*  For  exampley  Merge  may  return 

<fy  f=Cl  V  f=C2>J  HIGRFSS  can  then  choose  <a ( f ) y  R/a(f)>  from 
Liveforwardy  merging  the  paths  through  a(Cl)  and  a (C2) • 

Diverge  increases  the  constraint  on  the  possible  values  of  the 
currently  available  formal  objects*  This  permits  simplification  of 
world  descriptions  and/or  success  of  the  stopping  test*  For 
exampley  if  Restrict  is  f=Cl  v  i=C2y  and  the  portion  ol  the  plan 
a  I  ready  1  oun  ti  is  a(f);b(f)y  choosl  ng  a  NewRestrlct  of  F=C1  splits 
oft  the  path  through  a(Cl);b(Cl)*  The  final  condition  in  Diverge  is 
a  heuristic  that  avoids  constraining  the  formal  objects  in  such  a 
way  tliat  the  goal  states  become  unobtainable* 

The  r.iocJi  f  ica  t  ions  to  the  introduction  of  conditionals  by 

DIGRESS  are  necessary  to  insure  that  both  branches  receive 
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compatible  bindings  lor  previously  introduced  tormal  objects# 


7.3  CORRECTNESS 

It  is  merely  necessary  to  show  that  conditions  (i)  -  (v)  above 

hold  • 

(i)  and  ( ii )  are  obviously  true.  PlanRestrict  is  simply  the 
final  parameter  to  BIGRESS  on  its  last  recursive  call.  Diverge 
explicitly  maintains  conditions  (iv)  and  (v)»  and  it  is  readily  seen 
that  Merge  does  as  welll 

(Restrict  a  NewRestrict)  3  Restrict 
is  a  tautology!  and  if 

(E  NewForraCbJs )  NewRestrict 

and 

GI-*  (E  FormObJs)  Restrict 
then  certainly 

GV-*  (E  NewFormCb Js  )  (  E  FormObjs) 

(Restrict  a  NewRestrict) 

Condition  (iii)  is  proved  by  induction  on  N,  the  number  ot 
calls  to  BIGRESS.  Attach  the  phrase  "for  l<=i<=k"  after  eacli 
formula  Involving  ri  and  si  in  the  following  sketch. 

If  N=l»  then  plan  =  null  and  Gh-  riosi.  Sc  for  any  formula 
PlanRestrict,  Gl-  PlanRes  t  r  i  c  t^  (  rl3  [  nul  1  ]  si  )  . 

So  suppose  (iii)  holds  for  any  number  of  calls  less  than  N. 


The  top  level  of  BIGRESS  chooses  one  of: 


FORMAL  OBJECTS 


Pa^e  103 


— 1.  i  veForwtt  rd :  The  recursive  call  constructs  a  Subplan  such 

t  hat 

Gl-  PlanRestrlct  :3  (ri/A  =>  £Subplan]si) 

So 

GH  [ A ]Pla nRes trie t  3  ( ri  ^  [ A ; SubpI an ] si ) 

The  reason  for  usiii^  only  invariant  predicates  in  restriction  wlfs 
becomes  clearl  it  neans  that 

GP-  PlanKestrict  o  [A]  PlanRestrict 
so  that  we  obtain  the  desired  condition! 

GP-  PlanRestrict  ^  (ri  ^  [  A  ;  Subplan  ]  si  ) 

An  interesting^  generalization  raay  be  to  allow  non  — i  nvari  an  t 
predicates  in  restriction  wflSf  and  explicitly  progress  or  regress 
the  restriction  throvigh  the  action  A* 

- L i veBackwa rd f  NonTriv:  Are  handled  similarly# 

- Merge:  By  the  Indvjction  hypothesis, 

GK  PianPestrict  3  (ri  a  NewFestrict  3[Pla.n3si) 

So 

GP-  (PlanRestrict  a  NewRestrlct)  ^  ( ri  =>[  Plan  ]si  ) 

By  ( 1 V ) , 

Gh-  PlanRestrict  3  Restrict  a  NewRestrlct 
Propositional  reasoning  allows  us  to  derive 

GH  PlanRestrict  ^  (ri  ^[Plan]si) 

— Diverge:  Sinilar  to  Merge# 
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7.4  INTELLIGENCE 


Some  intelligence  needs  to  be  built  into  Merge  and  Diverge 
before  they  can  add  any  ’’power”  to  DIGRESS.  It  is  useful  to 
in  troduce  formal  objects  when  the  current  LiveForward  or 
LiveBackward  sets  contain  a  large  number  of  actions  which  differ 
only  in  one  or  two  parameters.  Heuristics  could  be  includedy  for 
exampley  to  introduce  a  formal  object  whose  new  restriction  wff  is  a 
disjunction  of  equalities  with  each  of  these  parametersy  or  is  the 
proposition  that  the  formal  object  is  of  the  proper  type  to  be  a 


parameter  of  the  action. 


The  new  restriction  wff  can  simply  be  true  for  formal  objects 
used  in  backwards  search.  The  possible  values  for  the  formal  object 
are  ’’automatically”  constrained  by  the  regression  process.  For 
exampley  suppose  the  sole  dynamic  axiom  is: 

Vxy(pl(x)  A  p2(y)  =  [a(xyy)]  q(x)) 

and  s=q(C).  Then  Merge  can  introduce  a  formal  object  f  with 
NewRes tr 1 c t= true y  so  that  Restrict  is  unchanged.  Now 
a(Cyf)\q(C)  =  pl(C)  A  p2(f).  In  order  to  reach  this  new  goal  statey 
r2(f)  must  be  be  achieved. 


As  we  saw  in  earlier  examplesy  world  descriptions  become  quite 
unwieldy  when  large  numbers  of  free  variables  are  present.  Diverge 
can  be  selected  in  such  cases  to  simplify  R  and  S.  When  a  formal 
object  f  is  constrained  to  be  equal  to  a  single  constant  Cy  one  can 
replace  all  instances  of  f  by  C  in  R  and  Sy  and  systematically 


evaluate  the  equality  predicates  in  R  and  S  which  involve  C. 
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BIGKESS 

stio  ul  d 

know  when  a 

stronger  restriction 

wff  can 

1  ead 

i aimed  1  at  e  1  y 

to  a 

solution  to 

the  planning  problem* 

Each  j*osi 

t  i  ve 

answer  to  the  query 

GH*  (  E  ForiiiOb  Js )  (Restrict  a  (Restrict  3  (ri^si)}) 

which  holds  across  all  the  constraints  can  be  used  to  construct  such 
a  restriction  wll.  This  special  case  ot  Divert;e  could  be 
efTlciently  incorporated  in  the  stopping  test  itself* 


7*5  EXAMPl.E 

Use  ttie  level  1  dungeons  world  axioms*  Let  R^s  be 
loc  (GOLD,  LAIR  )  r)  [u]  1  oc  (  GOLD,  CAVE  ) 

In 

JIGRi:SS(loc(GOLD,LAIR)  ,  1  oc  ( COL  E  ,  CA  VF  )  ,  (},  true) 

the  set 

L  i  V el’o rward  (  loc  (  GOLD  ,  CA  VE  )  ) 

contains  t i ansf er ( GOLD , LA IR , x )  for  every  room  x*  Instead  of 
searchinng  through  transfer (GOLD , LAI k , HOME ) , 

i 

t rans f er ( COL D , LA  I  R , P IT )  ,  etc*  (until  finally  hitting  on 

transfer ( GOLD, LA IR , CAVE ) )  DIGRESS  can  choose 
< ( f }  ,  r oora (  f ) > 

from  Merge(  (}  )  ,  and  recursively  call 

HIGRESS(  loc( GOLE ,LA1 k)  a  room(f),  loc (GOLD , CAVE )  )* 

Then 

<transfer (GOLD ,LA IE, f ) ,  loc(C0LD,l)  a  room(f)> 
should  be  chosen  from 

L IveForward ( loc ( GOLD , LA  IE )  a  room(f}). 


effectively  merging  all  forward  branches* 


The 


stopping 


test  in 
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EIGRESSC  loc(GOLD»l)  a  rooin(±)j  loc  ( GOLD ,  CAVE )  )  would  be  satisfied 

if  f=CAVE;  So  BIGRESS  should  choose  f=CAVE  from 
DivergeC  (f}  y  rooni(f  )  )  • 

The  innermost  call 

BIGRESS(  loc(G0LE,f)  a  room(f)  a  f=CAVE,  loc ( GOLD , CAVE ) , 

£f}  ,  rooni(F)  a  f=CAVE  ) 
terminates  the  searchy  returning 

<transf er (GOLDy LA IRy f ) y  (f ) y  room(f)  a  f=CAVE> 

7.6  SELECT  STATEMENT 

The  final  restriction  wff  may  be  more  general  than  a 
conjunction  of  equalities.  The  plan  constraint 
loc(SWOKDyCAVE)  =[u]  -.loc  (  S^OKE  y  CA  VE  ) 
could  lead  to  the  solution  set 

<transfer (SWORDyCAVEy f>y  (f}y  room(f)  a  f^CAVE> 

How  shall  the  planner  maRe  use  of  such  a  solution?  It  could 

immediately  find  a  constant  binding  for  fy  and  substitute  it  into 
the  plan.  But  if  this  plan  is  to  be  incorporated  into  a  larger 
sequence  of  actionsy  it  may  be  more  efficient  in  the  long  run  to 

choose  the  bindings  lor  formal  objects  at  execution  time.  This  can 
be  done  by  inserting  a  new  type  of  statementy  se lec  t  y  at  the 

beginning,  of  the  plan. 

A  selec  t  sta t eaent  is  written 
SEL( f 1 y . . . y fn ) Res 

where  the  li * s  are  variables  and  Res  is  a  nonmodal  wff.  We  shall 

only  admit  a  select  as  the  first  statement  of  a  solution. 
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A  solution  set  of  the  form  ^ 

<Pianf  P 1 anFormCb Js t  PlanPestric t> 

Is  transformable  to  the  plan 

SEL  (  Plani'orniOb  Js  )  Plan  Res  trie  t ;  Plan 
The  solution  to  the  example  above  can  thus  be  written 
SEL(f)  (roora(f)  a  f^CAVE);  t ran sf e r ( SWCRD , CA VE , f ) 
and  we*d  expect  that 

ioc  (  SWOPD,CAVE )  =J[SEL(f)  (rooia(f)  a  f^CAVE); 

transfer (SWORD, CAVE, f ) ] 

-.loc(  SWORE, CAVE) 

SEL  can  bo  t^iven  precise  semantics  and  axiomaticsl 

M(SEL( f 1 , . . . ,fn) Res)  = 

((I,J)  1  E  dl,«*«,dn  e  DOAiA  IN  such  that 

Cdl/ f 1 , . . . ,dn/fn} I  =  J 
j|=  Res} 

[ SEL( f 1 , .  . . , f n ) Res  ]0  =  (¥  f  1  , . .  .  , f n ) ( Res  3  Q) 

It  is  then  easy  to  verify  that  if  no  formal  objects  appear  in  R  (as 
on  tlie  first  call  to  DIGRESS),  that 
Gl-  Res  3  (R  3  £u]  S) 

iff 

GF  R  3  (  SEL(  ForniCbJs  )  Res  ;u  ]  S 
Select  preserves  rm^i^na t^ on  iff 
Gl-  <S EL  (  ForraOb  J  s  )  Res>  true 
or  equivalently 

Gl-  (E  ForrnObJs  )  Res 

- which  is  a  condition  for  Res  to  be  an  acceptable  restriction  wff. 

Select  is  the  only  n_op;~  t  r  a  n  _s  p  are  n  t  action  we*ve  discussed,  and 
as  such  really  falls  beyond  the  scope  of  the  current  paper.  A  more 
complete  development  of  the  select  action  would  lead  into  general 
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CONCLUSIONS 


8.1  SUMMARY 

This  t  ties  is  ex 
the  situational  c 
problem  decoiaposit 
formulation  of  plan 

I  extended  the 
special  version 
parameterized  actio 
contexts.  Rosensch 
of  the  lanfuaiie  and 
could  contain  both 

A  nunber  of  ex 
problems  were  wor 
dynamic  logic  appro 
with  non-exact  plan 
formal  objects  in  t 


ami ne  d  planning  formalisms 
alcuiusy  state— space  mode 
iony  and  tlieir  influenc 
ning  in  propositional  dynaia 


and  systems  based 
Isy  and  hierarchi 
e  on  Rosenschei 
ic  logic. 


on 

cal 
n  *  s 


formulation  to  Transparent  Dynamic  LogJcy  a 
of  first-order  dynamic  logic  which  includes 
ns  and  allows  substitution  of  terms  through  modal 
ein's  BIGRESS  algorithm  was  extended  for  a  subset 
proved  correct.  Goals  and  state  descriptions 
quantified  and  disjunctive  information. 

ampies  of  single— level  and  hierarchical  planning 
Red  out  whicti  demonstrated  the  strengths  of  the 
ach  over  STRIPSy  non-linear  plannersy  and  those 
hierarchies.  Finallyy  an  approach  to  the  use  of 
he  plan  generation  process  was  sketched. 
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S.2  FUTURE  WORK 

The  most  gapin4>  holes  in 
of  the  progression  and  regr 
characterization  of  the  first- 
answer— genera  tion  process  can 
answers  and  always  terminate, 
semantic)  that  the  formula  der 
the  strongest  provable 

precondi t ion ) • 


the  present 
ession  func 
order  plann 
be  guarant 
Next  f  we 
ived  from  a 
pos  tcondi t 


work  concern  completeness 


tlons.  We  need  a  syntactic 
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Many  extensions  to  the  framework  suggest  themselvesi 

It  is  desirable  to  be  able  to  refer  to  entities  lor  which  no 
constant  or  plan  parameter  is  known.  The  present  system  cannot 
handle  a  command  likef  "pick  up  the  block  on  the  table".  The  Select 
action*  discussed  in  Chapter  7*  provides  a  mechanism  for  explicitly 
binding  a  variable  to  an  entity  which  satisfies  some  description  at 
a  specified  point  in  the  plan. 

We  made  actions  transparent  by  effectively  banning  non-rigid 
terras  other  than  variables.  It  would  be  useful  in  the  Dungeons 
World  to  have  a  terra  "loca tion-of - robo t"  whose  referent  is  changed 
by  the  "go"  action.  But  if  an;^  action  is  allowed  to  change  the 
referent  of  an;^  tera*  we  could  be  stuck  with  frame  axioms  for  the 
unchanged  terms. 


Dynamic  logic  includes  a  Iransitlve  closure  operator  "♦*•*  not 
described  in  this  thesis*  which  can  be  used  with  the  ?  and  U 
operators  to  construct  loops.  We*d  like  to  extend  BIGRESS  to 
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construct  plans  with  loopsy  such  as  "Put 
"Walk  nortli  un  ti  1  you  reach  CASTLES". 


a^JL  the  blocks  in  BOXl", 


or 


8.3  CONCLUbING  PEMAKKS 

No  attempt  has  been  raa 
this  thesis.*  A  p r a  c  t i c a 1 
amount  ol  theorem  proving 
progression  and  re^resslo 
given  a  uniform  forncal  trea 
theorem  proven  should  limit 
suggested  in  section  4.5.6* 
equality  in  full  general 
prohibit  ttie  use  of  exist 
parameterst  thus  eliminatin 


de  to  implement  the  system  described  in 
implementation  must  carefully  control  the 
performed  in  the  stopping  test  and 
n  functions.  Although  frame  axioms  are 
tment  with  other  dynamic  axioms*  the 
their  role  in  the  resolution  process*  as 
.  It  remains  very  costly  to  Iiandle 
ity;  a  preliminary  implementation  may 

en t ia 1 ly— quan t i f i ed  variables  and  plan 
g  the  need  lor  frame  axioms  for  equality. 


Still,  the  dynamic  logic  framework  is  useful  if  only  for  its 
ability  to  describe  and  formalize  various  approaches  to  the  planning 
problem.  The  world  does  not  need  another  program  that  solves  the 
three-block  problem;  an  elegant*  increraentally  extendable  theory  of 
planning  is  of  considerable  interest. 


*An  implementation  based  on  an  extension  of  the  propositional 
framework  to  propositional  schemata  has  been  completed  at  SRI 
details  are  expected  to  appear  in  [Rosenschein  (forthcoming) J. 
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